Sharing merchant values means sharing a respect for honest exchange. A good merchant does not merely sell; a good merchant learns what people need, offers...

I have been exploring a radical computational physics hypothesis: What if matter, gravity, measurement, and even consciousness can be modeled from one...

The maker movement can build almost everything around intelligence. The board. The enclosure. The firmware. The harness. The test rig. The repair manual. The...

This isn’t slop, it’s translation: You take rough, unstructured thoughts and use GPT to turn them into clear writing! Most content online has historically...

How Much Radio Do You Actually Need? I fed FM RF into a single FPGA input pin and let the pin's logic threshold become the receiver's front edge. A...

I built an FM receiver with one FPGA input pin. Not “one-chip radio.” Not “a tiny SDR module.” One input pin receives the RF. The FPGA threshold turns it into...

Magnetic Paramp plus Second‑Harmonic Saturable‑Core Downconverter — Seeking Experts and Sources I’m building a focused research thread on a fully diode‑free...

Do you want to be more correct or not? TL;DR: ACT MORE For all #builders, #engineers, #inventors, and all kind of problem solvers in life. Let go correctness...

Why I Need This Instrument I am building this because ordinary computers hide the parts I care about most. They hide structure. They hide ownership. They hide...

Soldered the first batch of hermaphrodite connectors onto my purple MUX tiles. After ~25 years of “designing in my head / on paper / in CAD,” I finally have a...

Chain-of-thoughts reasoning model architecture is a mistake. It does improve results. It does put you on leaderboards, but have you ever asked yourself, "Why...

In short: Even with AI, the core lessons of No Free Lunch, No Silver Bullet, and The Mythical Man-Month still hold: there is no universal algorithm, no single...

Procedurally-generated textures allow cheap pixelless textures. SDF in 2D is 1 eval, much cheaper than in 3D. So we use UV-SDF in texel space. Sprinkle...

In the late 1970s, Ed Catmull at the University of Utah developed foundational graphics methods like z-buffering and texture mapping. By 1979, he joined...

🔥 Silicon had a good run—now let’s leap 10,000× beyond it. 🔥 Imagine logic elements whose cobalt nano-cores flip at the kT irreversibility limit—the...

I am pretty sure chip industry is a PhD's business, not even blue collar's. EU could win this game in long run, with all the university support... What we...

DINOv2 SALAD is the SOTA single-stage VPR (Extractor-Retriever-Matcher for images). It uses Optimal Transport DUSTBIN, just as SuperGlue did in the late 2019....

ASML makes machines to make chips at TSMC. Computational photolithography makes it work. Nvidia makes machines at TSMC to compute that. Closed cycle....

The choice of loss function is a significant difference between training a generative language model (LLM - Language Model) and training a vector search...

Bizarre fun training a LLaMA-2 FROM SCRATCH 500k parameters on the TinyStories dataset (trained overnight on CPU in PyTorch: ModelArgs(dim=103, n_layers=5,...

Can you believe that #RAG is solely based on a quirk in #LLM of its capability to solve a very specific problem (and, of course, an additional summarization...

My good friend and inspiration of the last 20 years since 2003 in everything I did computer science-related, was, and forever will be Carl Hewitt, died a year...

To do AI arithmetic well on chips, all you need to master are CSA and PPA. Everything else is just Harel UML Statecharts, meaning you must already be an...

If you don't know how to multiply and add numbers, you don't know anything. Learn, how IBM, Nvidia, Intel, AMD multiply numbers, transistor-by-transistor. All...

Keep in mind it takes AMD and academia in Texas to make a new A x B + C chip compute unit. The complexity of a simple FPU FMA is overwhelming not because it's...

To learn math of Transformers you just have to study Calculus and mathematical analysis for five years at uni, for 10 years out of curiosity, then four years...

In 2010, Martens invented deep Hessian-free methods. In 2011, Sutskever collaborated with Martens to apply it successfully to arbitrary RNNs (not special...

Excellent summary of important issues highlighted. The reality is indeed many worlds, and it is indeed over the path integral, and the Feynman-Wheeler...

One of the most important contributions to computer science, machine learning, and automated digital circuit design genetic programming was made by Yoshua...

To boost your intuition about the formula of cross-entropy (or neg-log-likelihood, as they confusingly call it). These series show up in eigendecomposition...

I just came up with an idea of use a linear autoregression to model the nonlinear autoregression generating function of a heavily nonlinear process (yes,...

Computer scientists and mathematicians use functions to make predictions: give me input arguments, I'll tell you the value of that function in simple...

Pay attention: LeNet from 1989 used SGD with momentum, and so ImageNet of 2012. All you needed for old school was Averaged SGD with momentum. 1 million other...

Probit is inverse of cdf of Gaussian curve. Argmax is inverse of softmax. Logit is inverse of the sigmoid. Derivative of the the cdf is the Gaussian curve....

NVIDIA GPUs are powerful tools for specific parallel computing tasks, excelling in workloads that can be massively parallelized, such as scientific...

If we have two states in vector representation on infinitely-dimensional Hilbert space, and we're trying to trace the transition probabilities from one such...

Lattice regularization. Operators are just continuous version of measurement tensors. Spacetime probability amplitudes of your favorite fields and the field...

This ChatGPT is pretty good, but I'd love to find any human collaborators who are interested in developing my draft theory of many-words discrete photons with...

Of course, attention came from Gaussian mixture models and density networks, soft windows, that was realizing the concept of dynamic weights--historically--as...

More actual than ever, after using it for so long, after diving into bits and pieces (thanks to Andrey and Georgiy), after teaching a student how to write and...

Everyone is talking about Moore's law, but few know that there's a Second Law. As a researcher in alternative chip technology, I invented a process that does...

In the wild era of AI, ML, LLM, GPT #democratization, individuals and businesses of all sizes deserve the following #rights: 1. The right of #fabrication...

Joining the amazig ShaderToy community, learning how to use SDF, and writing all my next ASIC circuit simulators in GLSL instead of Verilog since 2019 was the...

Reversible computations, as the only possible quantum compute mode, when scaled and overcome the cryo energy efforts, will certainly revolutionize the...

I struggle to fight against this trend of burning I/O and melting down the core. Have anyone ever care to quantify the ineffieciency of SerDeses, waste of...

"Intrinsic Metrics and Mutual Information: From Abstract Measurements to Machine Learning" Chapter 1: Introduction Motivation for the book Overview of the key...

Yann LeCun has expressed his doubts about both LLM and RL. I came to same conclusion re: RL in my intensive ML studies in 2022. I also would like to add...

ADHD data processing is nonlinear. I physically read a thousand of books in parallel. Ten thousand of papers. Simultaneously. My space looks like a hoarder's....

Chatbots can hype and fade, AGI hype will dissipate. The Autoencoder built on Transformers forever will remain more efficient method of mathematical...

The easiest way to explain my project codenamed "Cartilage" (under brand name "Material Programs") is to compare it with Hadoop. If you are familiar with...

scott hauck was using FPGAs in Seattle to teach students 20 years ago. These days nobody understands them anymore. While my data science student asked if he...

(I need to decide this to mysef as well!) My opinion is very simple: if you're PUBLIC, and people KNOW ABOUT YOUR EXISTENCE, in 2023 you MUST BE OPEN SOURCE,...

AI is not a tool. AI is mathematics. A much better math, than we had a century ago. Do not try to understand how to use GPT-4. It's not a tool. Teach kids...

Mathematics we call "predictive models" are not innocent matters, and these are surprisingly equivalent classes to control theory. We've being told that...

1. Entanglement is easy: interactions form irreducible multi-component emergent scale structure. The information about which must exist somewhere, after all....

Well. Let me make a chip at home then, if there's such right? Let me to implement, without the Ivy League's intentional obscurity, behavioral design, AI,...

...which reminds to us all that SOFTWARE DEVELOPERS, and NOT SysOps, are NUMBER ONE frontline of #cyberdefence and #cybersecurity No matter how sweet and...

ASIC designers in VLSI are the best people to trust reactive programming software insight. What advice you can share regarding completeness of multi-bit...

This video explains that "Every body continues in its state of rest, or of uniform motion in a straight line, unless it is compelled to change that state by...

My "Why" is to enable tinkerers with continuous iteration with ultra short turnaround times. My "Why" is to empower every local community with ability to...

Does inventing an alternative to semiconductors to realize Verilog at home makes your brain melt too? Magnetic amplifiers, ferroelectric capacitors, micro PCB...

We have a good set of ideas, how OpenCL kernels can be automatically allocated and managed in a coding and configuration-less distributed and secure manner...

Yes, but: 1. After all LUTs are occupied, I can't add a new line of Verilog. In C and C++ I can. 2. In C I can malloc(), in C++ I can new. In Verilog all I...

Have you tried to use this for general-purpose compute? I wonder how easy it will be to write parallel SOURCE CODE for it, one orchestrated parallel...

When you fill up your entire largest FPGA, when you have to break away from one single chip package, when you have to partition your logic, and lower your...

Our #Cartilage project resembles Inmos #Transputer, Nicholas Macias' #CellMatrix, and uses micro-FPGAs with analog 1-wire SerDeses for power distribution and...

It's good to hear the word "FPGA" of this beautiful, but obsolete technology. More software engineers will learn what reactive parallel beauty is hidden on...

7 months ago I wrote a GLSL shader for nano-FPGA fabric. I think prior art law holds, because ShaderToy.com is a findable on Google Search web site. Don't...

The sources of inspiration were found in the movies: She Fell From Clouds (1978) on fixing things and replicating physical objects, Prototype (1983) and Short...

People think that CPUs are clever machines, and in order to do computation, these clever machines are the fundamental level of reality. I love to teach...

The following are projects (in the order of laser-sharp short term focus) we are working on (volunteer's help appreciated; early co-founder opportunities for...

#focus and say "no". At what I'm working on, there's no place yet to quantum computers, exciting photonics, and even deep reinforcement learning. Although I...

I want to share with you my recent thought that came on a walk just a minute ago... It's for software developers and computer science engineers. It's about...

Did you know you can migrate from your favorite powerful language that's so good at defining domain-specific languages (DSLs) but has this prominent Achilles'...

Promoting a new, exciting, massively parallel and scalable programming language is HARD! But the lessons from adopting #erlang and #elixir will 100% be...

You can't port your legacy cloud infrastructure easily to any other platform, unless it's a generalized superscalable supercompute cluster of...

Soon you'll be able to parallelize and get a supercompute concurrency speedup, putting ALL your custom backend code, no matter PHP, C#, Python, Perl, Node,...

In 2019, I learned the model of computation of Verilog. For almost three decades, I was writing application software and soldering digital circuits. I mean, I...

I think scalability of Hilbert's 13th problem in the form of a neural network or sum of products function of many, many, really many variables! We will be...

Erik Larson please, add me to your 1st circle on LinkedIn (PM to schedule a phone call that I can express my gratitude for expanding my world view so...

Genuine breakthrough IMO. ML+Quantum is the only working mix. In the years to come, we'll see more fantastic progress in the area of precise quantum-aligned...

This stuff is so cool. Was trying to create a programming language for 20 years. To write an operating system from scratch. To reinvent the way computer...

I am pretty seriously believe that for almost 100 years we haven't made any significant improvement on top of the Alan Turing/John von Neumann computer...

You probably heard and applied the strategy that is highly influential among DevOps and DesOps practitioners, and especially among Silicon Valley founders and...

"A grain of dust one micrometer across, after being illuminated by the sun for just one microsecond, will have its location imprinted about 100 million times...

To be "not afraid of constructive critique" is not enough. It's only disseminated thought that can be improved. The world perhaps has evolved as a process of...

TSMC must form the top scientific, technologist, and engineering forum, along with ASML, and form a CONSORTIUM, where they will keep "all Einsteins in the...

Erik J. Larson did a big deal of a deep reinforcement learning work for DARPA span over a several decades. He found, that humans somehow are capable of making...

Anesthetics act on each individual cell, stopping the kinesin motors => our consciousness is bound to sentient beings, which are each and individual living...

I have read and completely understood Sabine's paper she wrote in collaboration with Palmer in 2019, "Rethinking Superdeterminism." I feel that many-worlds,...

In server architecture, when architect faces a high likelihood of DDoS, the solution is simple: geo-distributed capacity increase. Why we haven't anticipated...

This experiment is one of the best demonstrations of the acausal and quantum nature of reality. Look, when you look at something which is black, there's no...

So ability to PRODUCE chips is overarching. Designing IP is a huge and deep industry. But in tracking a dependency graph, OF COURSE you need to grow silicon...

Intellectual property, technological supremacy, patents, lawyers, proprietary secrets, cybersecurity, walls and warfare, industrial espionage, controlled...

I deeply despise the leaks Assange and Snowden did. National security of any country is the business of the country, not public. You don't share where your...

Steve Haak and Olivier De Wulf please tell Ben Horowitz that Web 3.0 has passed long ago, and Industry 6.0 better aligns with modern versioning. Web 3.0 was...

Turing (mis)directed us to search for learning machines. Von Neumann has coined a misdirecting term "singularity". Von Neumann has also invented cellular...

I'm looking for seed series capital to build an FPGA cloud, where people can make their designs run, share, and reuse, both open and proprietary. To even host...

Imagine that there is a capability to call a web service. Anytime, anywhere, with a perfect documentation. And you are trying to make a LARGE commercial...

CPUs and software are capable to solve only a NARROW class of computational problems, not only in terms of efficiency, but also in the management of...

Have you ever thought that you can write a mini-FPGA code and instantiate it in the rest of your Verilog code, and feed it with your custom mini bitstream?...

Boolean logic is everything. It is massively parallel. It is dynamic. It is reactive. No need to reinvent the wheel. But an extreme need to raise...

I made a simple estimate: it seems we're not doing cellular automata for a wrong reason. A fully pipelined FPGA chain, even at 16 nm node at 891 MHz has...

Do you realize how BAD conventional code is? If you imagine code as circuits, good luck with reasoning about something happening as inside of a black box (you...

Two years ago, after analyzing the object-oriented-inspired cellular automata I made, I reinvented the wheel called "Binary decision diagram". Turns out, it's...

And not just imaginary then, but the entire structure of the "object-oriented" geometric algebra with "strict types". If you haven't checked how geometric...

I am overwhelmed by complexity. Please, stop showing how clever you are, and making the world a more complex place. Kids, UX designers, PMs should be able to...

Open hardware IP cores, open wi-fi, open 5G IP, open USB are coming! The end of Moore's Law can be only solved by an npm-like Cambrian explosion where all...

Opinion | Moore's Law Grand Finale If you're business founder, you know... You have to grow. All successful businesses are based on growth. Apple, Google,...

Wow, this type of abstraction this amazingly crystal clear minded author argues about is exactly what my research group at Solid State Pros working on for the...

Hydrogen: yes. Super-efficient gas turbine or hydrogen fuel cell: yes Solar: I'm not sure (okay to make compressed hydrogen to replace gasoline, any other...

A unicorn inventor? Invent a portable $400-cheap 2 kilowatts continuous power source lasting one year without recharge. (It's an equivalent of 1.5 million...

$2.7T total addressable market! Two zero-carbon emission products (or at least, less than that of oil and natural gas). 1. $320,000 per unit (lasts 20 years,...

Play role games, please! Research engineers shine, when they play these information-intensive roles. One role at a time, with different responsibilities and...

We named our department "FTL Communications" at Solid State Pros LLC to stay motivated towards a big dream. We conjoined dynamic programming, mathematical...

The common thing between AMD and Intel is that the products they make has a very extensive use of IP: the proprietary circuit designs which small vendors...

The preliminary tests for 0.4 mm pitch #multilayerpcb #DIY #BGA #solderless process finally exceeded all my expectations (less than 1 ohm via resistance, and...

I'm so envious to those people who can make 6 mil printed circuit boards at home and solder 0.35mm BGAs to them in their freaking precise temperature oven....

Are you a neural networks training data scientist? Are you a programmer writing an object-oriented code? Are you a hardware design engineer? Study general...

Everything is great about Univalent Foundations and Category Theory until you give a deep thought to things like A&~A denial, axiom of choice rejection,...

Spent 7 hours at ProofWiki. Now I understand how Lie Algebras are rooted in Modules, Algebraic Structures, Division Rings, Rings, Semirings, Ringoids,...

Imagine learning Python constrained with the use of only "single argument and single return value" functions. No lists allowed. An exception is a vector or a...

A very important paper on the theory of numbers with broad applications (and implications) in quantum mechanics, machine learning, big data analysis, complex...

Just keep watching. It's easy. Absorb. This theory is really fundamental for everything your passion is at right now. Don't let the name "Classical Mechanics"...

Make sure you haven't skipped the introduction into Variational Calculus, otherwise nothing in physics and computer science will make sense. This is the VERY...

I recommend this introduction (the pdf textbook) for everyone who wants to do anything real, from physics simulations, #quantumcomputing, entanglement,...

Life on Earth can be the only Life in the entire Universe. If you write code long enough, you can see that. But if you toss coins, you can believe in Aliens,...

The Universe is made out of the same finite set of infinitely repeating structural patterns scaled to different sizes. Scale invariance is important concept...

Designing a distributed reactive programming language is the major stepstone on the long path to scalable Claytronics (programmable matter). Resource...

Thoughts on reversible computing... Copy of information is required to avoid re-computation of sub-branches of logic expressions. Everyone knows how the cache...

Interesting individual observation: studying mathematics, physics, computer science, philosophy, and even psychology for a long time, one likely starts seeing...

Ironically, product managers designing project management software, lack an abstract skill of the thinking about time as a spatial dimension. For decades,...

We discovered a surprising pre-condition to build a consistent declarative programming model of computation: it must be "surviving observer"-dependent!...

Please, join me on the next meetup about the new Model of Computation I have invented. We are doing a very active research on it right now. The concepts of...

Since my last major breakthrough made on October 6th at 2:15pm, excited over the incredible idea of how simple the computation can be made without any...