Tiny quantum tweaks give a production AI model a measurable edge
IBM and Multiverse Computing demonstrated a quantum-classical hybrid approach that inserts Cayley-parameterized unitary adapters into a frozen Llama 3.1 8B model and runs the training-then-inference cycle on an IBM 156-qubit Quantum System Two. The result is a 1.4% reduction in perplexity with only about 6,000 extra parameters (a tiny, 0.000075% increase), enabling the hybrid model to answer certain questions correctly that the base model got wrong. The work shows a path toward quantum-enhanced AI on real hardware, but faces challenges from quantum noise and the need for future work to encode the entire quantum circuit to push perplexity further with even smaller classical needs.