architectures and using different types of attention, or a mixture of experts models.
architectures . What's interesting about the democratic surround piece is that that choice architecture was originally a totally politicized concept and only later became
architectures people draw their support for their beliefs for their values and
And architectures , which we're going to defer a little bit, are specified, and those specifications are embodied in a real thing.
vast architectures of simulator lenses around it.
servicesoriented architectures , companies are moving their technology onto onto the web.
corporate architectures institutional architectures have to step back and realize that for the last 100 years the West became powerful the East
uh you know architectures and management systems?
so many RISC architectures which were beautifully architected,
our branching tree-like architectures of knowledge healthy and alive and evolving, which is what they're meant to do.
So some of the architectures that we're developing at the moon for reuse and for convenience,
There are architectures where you might be better off with treads depending, although treads are pretty heavy.
And that architectures of participation taken together with our knowledge of how to use them is going to enable us to do things that are even more fantastic than what we're able
comes out these architectures are going to be shaped and reshaped and the culture is going to change and we know
But aren't you curious if these architectures are all the same?
That the current large language model architectures are not capable of doing that because they have to move step by step
text diffusion models might use transformer architectures , it's not an autoregressive transformer.
And we're talking about different architectures of how to construct these neural networks such that the training and the inference on them is super efficient.
So there are nudges or choice architectures out there that you may be familiar with that make us vote-- for example, this is Neat Street's project.
might be able to use those architectures to get around censors.
So if you plan to support multiple architectures in OS's up front, even if you never do, you're
Howard: I was struck by architectures of participation when I wrote 'Smart Mobs'.
You had to redesign the architectures and the capabilities of the network.
structures as they call them Choice architectures uh that are influencing people's behavior even though we don't think that they do uh so they have a
I did have a lot of background with software architectures in general.
and if we can help them build new architectures to sustain these new modes of collaboration-- geodesic domes, performances.
Things that turn on things like Turing completeness and Von Neumann architectures and the theoretical limits of crypto, those are things that retain their longevity.
And this is connected to what Tim O'Reilly calls the architectures of participation.
and how they really were architecture um and they were good architectures I do believe the public is intimately involved in architecture and
organizations to work together very effectively whether it's collaborative technology architectures whether it's organizations
- For example, These AI model architectures are being invented about once every six months. And system architectures and hardware architectures
Like, how different really are these architectures ?
And at the same time, fundamentally the architectures have not changed.
And so some key ideas from that effort were design general multipurpose architectures , multimission architectures .
And I'll be talking about some of what some of those architectures might look like.
organizations of the future we ought to be thinking about how do we reinvent institutional architectures to actually lead to
It's a loop that keeps going where it's hard to describe when you look at architectures and they're exactly the same, but the code base used to train these models is vastly different-
But of course, it might be that there are other architectures that can just be much, much happier.
We will also continue to work with industry and other academia and government groups to refine the concepts and system architectures -- the different ways of organizing the data
What I'd rather do is have kind of in these examples, people think about new architectures .
gee, we want to change that flag because we're supporting multiple architectures and I'm like, no I really don't want to edit all these build files.
So the people who grew up in the post-Internet environment have a fundamentally different psychological set of structures like deep habitual architectures and expectations of
You're, you, we're optimizing across the entire stack of software from architectures to chips, to systems, to system software, to the algorithms, to the applications.
- Install base defines an architecture . And so there were other architectures at the time.
You know, there's several other competing architectures .
So things like thermodynamic, kind of metabolic things and all kinds of architectures and so on.
Using these models, AI agents could create their own learning paradigms, architectures , and research agendas faster than we could even understand,
Because we often forget that these were funded by taxpayers, and that they're not strictly private architectures or private systems.
This aesthetic, this form, this idea that we can manage best and free people most by building architectures within which they will make choices
And another subset of that is, of course, deep learning, in which we use neural-net architectures .