Writing Exchange

0 posts0 participants0 posts today

LobstersWhy I'm No Longer Talking to Architects About Microservices via <a href="https://data-folks.masto.host/@rmoff" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@rmoff</a> <a href="https://lobste.rs/s/0sf074" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://lobste.rs/s/0sf074</a> <a href="https://mastodon.social/tags/distributed" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#distributed</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://blog.container-solutions.com/why-im-no-longer-talking-to-architects-about-microservices" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://blog.container-solutions.com/why-im-no-longer-talking-to-architects-about-microservices</a>

LobstersAutomated architecture diagrams <a href="https://lobste.rs/s/dz8mdk" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://lobste.rs/s/dz8mdk</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://medium.com/thefork/automated-architecture-diagrams-53f538f615b7" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://medium.com/thefork/automated-architecture-diagrams-53f538f615b7</a>

LobstersMedium data and small data <a href="https://lobste.rs/s/7sxlox" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://lobste.rs/s/7sxlox</a> <a href="https://mastodon.social/tags/performance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#performance</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://neugierig.org/software/blog/2025/03/medium-data-small-data.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://neugierig.org/software/blog/2025/03/medium-data-small-data.html</a>

LobstersThe Best Way to Use Text Embeddings Portably is With Parquet and Polars <a href="https://lobste.rs/s/lwbuex" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://lobste.rs/s/lwbuex</a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ai</a> <a href="https://mastodon.social/tags/databases" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#databases</a> <a href="https://mastodon.social/tags/performance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#performance</a> <a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#python</a> <a href="https://mastodon.social/tags/rust" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#rust</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://minimaxir.com/2025/02/embeddings-parquet/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://minimaxir.com/2025/02/embeddings-parquet/</a>

Nicole HennigImport AI 400: Distillation scaling laws <a href="https://importai.substack.com/p/import-ai-400-distillation-scaling" rel="nofollow noopener noreferrer" target="_blank">https://importai.substack.com/p/import-ai-400-distillation-scaling</a> <a class="hashtag" href="https://bsky.app/search?q=%23AI" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a class="hashtag" href="https://bsky.app/search?q=%23scaling" rel="nofollow noopener noreferrer" target="_blank">#scaling</a>

Nicole HennigImport AI 400: Distillation scaling laws <a href="https://importai.substack.com/p/import-ai-400-distillation-scaling" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://importai.substack.com/p/import-ai-400-distillation-scaling</a> <a href="https://techhub.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://techhub.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a>

💧🌏 Greg CocksScaling In Branch Thickness And The Fractal Aesthetic Of Trees [In Art From Da Vinci To Mondrian] -- <a href="https://academic.oup.com/pnasnexus/article/4/2/pgaf003/7996468" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://academic.oup.com/pnasnexus/article/4/2/pgaf003/7996468</a> <-- shared paper -- [not my usual fare, but love the spatial mathematical components, although the maths is way over my head!] <a href="https://techhub.social/tags/spatial" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#spatial</a> <a href="https://techhub.social/tags/maths" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#maths</a> <a href="https://techhub.social/tags/mathematics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mathematics</a> <a href="https://techhub.social/tags/art" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#art</a> <a href="https://techhub.social/tags/painting" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#painting</a> <a href="https://techhub.social/tags/representation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#representation</a> <a href="https://techhub.social/tags/daVinci" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#daVinci</a> <a href="https://techhub.social/tags/LeonardodaVinci" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LeonardodaVinci</a> <a href="https://techhub.social/tags/MurraysLaw" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MurraysLaw</a> <a href="https://techhub.social/tags/tree" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#tree</a> <a href="https://techhub.social/tags/vegetation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#vegetation</a> <a href="https://techhub.social/tags/fractal" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#fractal</a> <a href="https://techhub.social/tags/fractals" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#fractals</a> <a href="https://techhub.social/tags/%CE%B1" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#α</a> <a href="https://techhub.social/tags/biology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#biology</a> <a href="https://techhub.social/tags/artwork" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#artwork</a> <a href="https://techhub.social/tags/radiusscalingexponent" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#radiusscalingexponent</a> <a href="https://techhub.social/tags/branches" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#branches</a> <a href="https://techhub.social/tags/branching" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#branching</a> <a href="https://techhub.social/tags/nature" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nature</a> <a href="https://techhub.social/tags/naturalpatterns" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#naturalpatterns</a> <a href="https://techhub.social/tags/proportions" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#proportions</a> <a href="https://techhub.social/tags/physiology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#physiology</a> <a href="https://techhub.social/tags/Mondrian" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Mondrian</a> <a href="https://techhub.social/tags/aesthetic" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#aesthetic</a> <a href="https://techhub.social/tags/aesthetics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#aesthetics</a> <a href="https://techhub.social/tags/scale" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scale</a> <a href="https://techhub.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a>

Leshem ChoshenWant to predict the behavior of a hypothetical LLM, e.g., a bigger mode with increased test time compute? From only your single\few models? Sloth scaling laws got you! 🦥🎯 Identify skills and scale!Paper: <a href="https://arxiv.org/abs/2412.06540" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://arxiv.org/abs/2412.06540</a> GitHub: <a href="https://github.com/felipemaiapolo/sloth" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/felipemaiapolo/sloth</a><a href="https://sigmoid.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://sigmoid.social/tags/ML" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ML</a> <a href="https://sigmoid.social/tags/nlp" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nlp</a> <a href="https://sigmoid.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#machinelearning</a> <a href="https://sigmoid.social/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LLM</a> <a href="https://sigmoid.social/tags/llms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llms</a> <a href="https://sigmoid.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://sigmoid.social/tags/data" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#data</a>

AsafScaling AI Infrastructure: Best Practices for Building Cost-Effective AI/ML Infrastructure."The difference between good and great AI infrastructure isn't just about technology—it's about building systems that scale efficiently with your business while controlling costs."<a href="https://azdv.co/blog/2024/12/scaling-ai-infrastructure/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://azdv.co/blog/2024/12/scaling-ai-infrastructure/</a> <a href="https://mastodon.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://mastodon.social/tags/Scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Scaling</a> <a href="https://mastodon.social/tags/Cloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Cloud</a>

Kent Pitman<a href="https://mastodon.social/@climatebrad" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@climatebrad</a> It feels to me like "build more housing" can't be the answer. You almost might as well say "make more land". It's not a durable solution. And it doesn't address the many other aspects of society that need to be addressed. Jobs food commerce in general, schools, the nature and flow of community itself.A favorite quote comes to mind."Better implies different." --Amar Bose, at an MIT Enterprise Forum event(He was trying to explain to sales people at stores that would sell Bose speakers why they had to make changes in how they set them up. "Couldn't they just do what they'd always done?" The people would ask. They were used to that and did not want to change. He was trying to explain succinctly why you can't just radically improve something and leave it the same at the same time. So he, explained, that slogan had emerged.)Surely higher population density at some point means using existing resources differently. I'm not pushing an agenda here, but I am observing that higher density feels less compatible within every person for themselves and traditional-ownership / rent-taking-for-profit model. Surely that brings a 2-tiered citizenship and breeds discontent/danger as inequality simmers. In computer science, we talk about building systems that scale, planning for higher traffic. This could really be done in a system that did not plan for scale without the architecting the system entirely, and I've even seen some of pine that every factor of 10 in scale requires a redesign.Sometimes the architectural plan is indeed to just add servers, but that has to be planned in, and there has to be a source of servers, and the system architecture has to be structured such that in the new model, all the necessary flows will happen correctly and resources won't be cut off from each other or too hard to access or too expensive. "Build more housing." does not sound like the kind of answer I could give in a job interview and expect to be hired, with the hiring manager saying "this person has clearly demonstrated their understanding of operating at scale". The answer is not of a shape that seems right to me, nor does it offer sufficient detail.A lot of capitalism seems to operate on a theory that you just twist some knobs and everything will just happen right without coordination. I think this is less and less true as either populations grow larger or resources grow smaller or resources become more stressed.I did not write the accompanying article specifically to address this issue, and yet I feel like it says some important additional things I might say here if I were to ramble on. It is not a complete discussion of scale, but more discussion of why I don't think the traditional ways of thinking about just turning a few knobs is likely to keep working. Losing Ground in the Environment <a href="https://netsettlement.blogspot.com/2019/09/losing-ground-in-environment.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://netsettlement.blogspot.com/2019/09/losing-ground-in-environment.html</a>It also just not addressed the issue of urgency, and the way in which urgency materially changes the set of usable solutions. I did try to address that issue here:The Politics of Delay <a href="https://netsettlement.blogspot.com/2024/10/the-politics-of-delay.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://netsettlement.blogspot.com/2024/10/the-politics-of-delay.html</a><a href="https://climatejustice.social/tags/climate" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#climate</a> <a href="https://climatejustice.social/tags/ClimateMigration" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ClimateMigration</a> <a href="https://climatejustice.social/tags/SystemsThinking" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SystemsThinking</a> <a href="https://climatejustice.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://climatejustice.social/tags/ScalingSoftware" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ScalingSoftware</a> <a href="https://climatejustice.social/tags/Community" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Community</a> <a href="https://climatejustice.social/tags/Housing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Housing</a> <a href="https://climatejustice.social/tags/LateStageCapitalism" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LateStageCapitalism</a> <a href="https://climatejustice.social/tags/capitalism" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#capitalism</a> <a href="https://climatejustice.social/tags/population" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#population</a> <a href="https://climatejustice.social/tags/collapse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#collapse</a> <a href="https://climatejustice.social/tags/inequality" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#inequality</a> <a href="https://climatejustice.social/tags/sustainability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#sustainability</a> <a href="https://climatejustice.social/tags/SocialPolicy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SocialPolicy</a> <a href="https://climatejustice.social/tags/SafetyNets" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SafetyNets</a>

LobstersStorage is cheap, but not thinking about logging is expensive <a href="https://lobste.rs/s/o6fn5n" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://lobste.rs/s/o6fn5n</a> <a href="https://mastodon.social/tags/debugging" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#debugging</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://www.counting-stuff.com/storage-is-cheap-storing-isnt-2/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.counting-stuff.com/storage-is-cheap-storing-isnt-2/</a>

LobstersHow Honeybadger migrated from Sidekiq to Karafka via <a href="https://tech.lgbt/@hibachrach" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@hibachrach</a> <a href="https://lobste.rs/s/zrvrrm" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://lobste.rs/s/zrvrrm</a> <a href="https://mastodon.social/tags/databases" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#databases</a> <a href="https://mastodon.social/tags/ruby" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ruby</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://www.honeybadger.io/blog/sidekiq-to-karafka/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.honeybadger.io/blog/sidekiq-to-karafka/</a>

Compsci Weeklybroccoli: A robust message queue system for Rust applications, designed as a Rust alternative to Celery<a href="https://github.com/densumesh/broccoli" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/densumesh/broccoli</a>Discussions: <a href="https://discu.eu/q/https://github.com/densumesh/broccoli" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://discu.eu/q/https://github.com/densumesh/broccoli</a><a href="https://mastodon.social/tags/compsci" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#compsci</a> <a href="https://mastodon.social/tags/distributed" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#distributed</a> <a href="https://mastodon.social/tags/programming" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#programming</a> <a href="https://mastodon.social/tags/release" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#release</a> <a href="https://mastodon.social/tags/rustlang" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#rustlang</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a>

Lobstersbroccoli: A robust message queue system for Rust applications, designed as a Rust alternative to Celery <a href="https://lobste.rs/s/abayld" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://lobste.rs/s/abayld</a> <a href="https://mastodon.social/tags/distributed" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#distributed</a> <a href="https://mastodon.social/tags/release" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#release</a> <a href="https://mastodon.social/tags/rust" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#rust</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://github.com/densumesh/broccoli" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/densumesh/broccoli</a>

ƧƿѦςɛ♏ѦਹѤʞWhat Numbers Do You Get by Iteratively Scaling a Matrix? <a href="https://www.youtube.com/watch?v=-uIwboK4nwE" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.youtube.com/watch?v=-uIwboK4nwE</a> <a href="https://mastodon.social/tags/maths" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#maths</a> <a href="https://mastodon.social/tags/mathematics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mathematics</a> <a href="https://mastodon.social/tags/Sinkhorn" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Sinkhorn</a> <a href="https://mastodon.social/tags/matrix" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#matrix</a> <a href="https://mastodon.social/tags/determinant" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#determinant</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://mastodon.social/tags/math" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#math</a>

Leshem ChoshenSloth: scaling law for LLM skills predicts benchmark scores (even from a single model per family). It is based on factor analysis and has family-specific parameters, making it interpretable and accurate!Paper: <a href="https://arxiv.org/abs/2412.06540" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://arxiv.org/abs/2412.06540</a> GitHub: <a href="https://github.com/felipemaiapolo/sloth" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/felipemaiapolo/sloth</a>🧵🤖📈1/8 <a href="https://sigmoid.social/tags/ML" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ML</a> <a href="https://sigmoid.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llm</a> <a href="https://sigmoid.social/tags/llms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llms</a> <a href="https://sigmoid.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#machinelearning</a> <a href="https://sigmoid.social/tags/NLP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NLP</a> <a href="https://sigmoid.social/tags/Nlproc" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Nlproc</a> <a href="https://sigmoid.social/tags/data" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#data</a>

LobstersMaybe It Shouldn’t Always Be DNS <a href="https://lobste.rs/s/rirg56" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://lobste.rs/s/rirg56</a> <a href="https://mastodon.social/tags/networking" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#networking</a> <a href="https://mastodon.social/tags/rant" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#rant</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://www.junctionlabs.io/blog/maybe-it-shouldnt-always-be-dns" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.junctionlabs.io/blog/maybe-it-shouldnt-always-be-dns</a>

LobstersShaping a better future for Bazel C/C++ toolchains <a href="https://lobste.rs/s/yaegiv" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://lobste.rs/s/yaegiv</a> <a href="https://mastodon.social/tags/c" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#c</a> <a href="https://mastodon.social/tags/c" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#c</a>++ <a href="https://mastodon.social/tags/compilers" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#compilers</a> <a href="https://mastodon.social/tags/hardware" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#hardware</a> <a href="https://mastodon.social/tags/practices" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#practices</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://pigweed.dev/docs/blog/06-better-cpp-toolchains.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://pigweed.dev/docs/blog/06-better-cpp-toolchains.html</a>

Erik JonkerIn a way it's great news that improving AI models by just scaling up seems to have run into problems. That will increase creativity and innovation to find new ways to improve models or maybe try new approaches. Also new combinations of technology can bring a lot. <a href="https://mastodon.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://mastodon.social/tags/innovation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#innovation</a> <a href="https://mastodon.social/tags/ICT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ICT</a>

TechHelpKB.com 📚Recently, some of that AI "scaling law" optimism has been replaced by fears that we may already be hitting a plateau in the capabilities of large language models trained with standard methods.<a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ai</a> <a href="https://mastodon.social/tags/scaling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scaling</a> <a href="https://mastodon.social/tags/law" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#law</a> <a href="https://mastodon.social/tags/optimism" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#optimism</a> <a href="https://mastodon.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llm</a> <a href="https://arstechnica.com/ai/2024/11/what-if-ai-doesnt-just-keep-getting-better-forever/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://arstechnica.com/ai/2024/11/what-if-ai-doesnt-just-keep-getting-better-forever/</a>

Recent searches

Search options

Administered by:

Server stats:

#scaling