Technologytechnology

Evolutionary AI tops backpropagation in 2024 tests

Evolutionary AI uses mutation and crossover to optimize neural networks where gradient descent fails. Why it hasn't become a standalone industry.
evolutionary-ai

Evolutionary artificial intelligence does not learn by adjusting weights through calculus. It breeds solutions. The approach selects, mutates, and recombines architectures the way nature selects organisms. Since the 1960s, when Ingo Rechenberg devised evolution strategies and John Holland proposed genetic algorithms, the field has been an academic curiosity. For most of that history it was considered computationally impractical for high-dimensional problems.

That changed in 2017. Google Brain published Large-Scale Evolution of Image Classifiers, showing that evolutionary algorithms could automatically generate neural architectures that rivaled human-designed ones on the CIFAR-10 and CIFAR-100 benchmarks. The cost was steep: 450 GPUs running for seven days. But the principle was proven. Machines could breed better machines without a human engineer choosing layer widths or filter sizes.

Yet evolutionary AI did not become a standalone industry. The highest-profile independent startup in the space, Sentient Technologies, shut down its AI operations in 2018 after burning through over $150 million in venture capital. Its intellectual property was acquired by Cognizant and later sold to TEKsystems in 2022. The techniques themselves survived, but they were absorbed into the AutoML and neural architecture search toolkits of Google, Amazon, and Microsoft rather than forming their own commercial category.

Google data center server racks GPU
erwinboogert, Wikimedia Commons, CC BY-SA 3.0

What Evolutionary AI Is and How It Works

Population, Fitness, Selection

Evolutionary AI treats architecture design as a search problem across a vast space of possibilities. It begins with a population of candidate models, each with randomly assigned structures and weights. The algorithm evaluates every candidate against a fitness function that measures task performance. The best performers are selected to reproduce.

Crossover and Mutation

Reproduction involves two biological mechanisms translated into code. Crossover combines parts of two parents to create offspring. Mutation introduces random changes to a single parent's design, such as adding a layer or altering a connection weight. Selection pressure ensures that only higher-scoring candidates contribute to the next generation.

No Gradients Required

Over hundreds or thousands of cycles, the population converges on architectures that outperform human-designed alternatives. This differs fundamentally from deep learning, which uses backpropagation to compute gradients and adjust weights incrementally. Evolutionary methods do not require gradients at all. They sample the fitness landscape directly, making them suitable for problems where the reward signal is sparse, deceptive, or non-differentiable.

Where Evolutionary Methods Outperform Gradient Descent

Sparse Rewards and Local Optima

Backpropagation requires a clear error signal flowing backward through every layer. Many real-world problems provide no such signal. A robot might receive a reward only when it reaches a goal, with no information about which prior actions contributed to success. Reinforcement learning handles this through trial and error but can get stuck in local optima.

Population Diversity as Escape Hatch

Evolutionary methods escape this limitation by maintaining a diverse population of solutions. If one candidate gets trapped, another may stumble onto a better approach through mutation or crossover. OpenAI demonstrated this in 2018 with Evolution Strategies as a Scalable Alternative to Reinforcement Learning. The researchers showed that evolution strategies could train deep models for complex control tasks using thousands of CPU cores in parallel, achieving results competitive with state-of-the-art reinforcement learning.

Uber's Deep Neuroevolution

Uber AI Labs reached a similar conclusion in 2017 with Deep Neuroevolution. Its genetic algorithms evolved neural weights directly for Atari game playing and performed competitively with deep reinforcement learning. The key advantage was simplicity: evolution strategies require no value functions, no experience replay buffers, and no target networks. They just generate, test, and select.

The Compute Barrier and How Hardware Broke It

Brutally Parallel, Brutally Expensive

For decades, the barrier to evolutionary AI was raw compute. Evaluating a population of thousands of candidates requires running each one on the task, which is trivially parallel but brutally expensive. Google's 2017 architecture search required 450 GPUs for a full week. That compute budget was unthinkable outside large corporate labs before the cloud era.

Cloud Economics Change the Equation

Cloud infrastructure changed the economics. GPU clusters on demand and spot pricing made it feasible to run large evolutionary experiments for a few thousand dollars instead of millions. OpenAI's evolution strategies paper used 1,440 CPU cores in parallel, a scale that would have been impractical without cloud orchestration. The hardware shift lowered the entry barrier from national-lab budgets to startup-level spending.

Sample Inefficiency Remains

But sample inefficiency remains a fundamental limitation. Evolutionary methods typically require millions of fitness evaluations to converge. Each evaluation means running the model on a batch of data. For image classification, that is manageable. For robotics, where each evaluation requires a physical robot to move, it becomes prohibitive. This is why most evolutionary robotics work happens in simulation, which introduces its own problems.

Cognizant office building exterior
PriteshRawat7d, Wikimedia Commons, CC BY-SA 4.0

The Reality Gap: Evolving in Simulation, Deploying in the Physical World

The Simulation Trap

Evolving a robot controller in simulation is fast and cheap. But the controller that works perfectly in a physics engine often fails on a real robot. This is the reality gap, the central criticism of evolutionary approaches in robotics. Simulations are approximations. Friction, motor latency, sensor noise, and mechanical wear are never modeled perfectly.

Bridging Techniques

Researchers have developed techniques to bridge the gap. Domain randomization varies simulation parameters randomly during evolution so the resulting controller is robust to a range of conditions. Another approach evolves controllers that are inherently conservative, trading peak performance for reliability. Neither method eliminates the gap entirely.

Narrow Applicability in Architecture Search

The reality gap also applies to architecture search. A design that scores well on CIFAR-10 may not transfer to larger image datasets or different hardware. Google's 2017 architectures were evolved specifically for CIFAR-10 and CIFAR-100, and the paper did not claim they generalized. This narrow applicability has limited the commercial appeal of pure evolutionary architecture search compared to more transferable methods like weight-sharing.

The Commercial Arc: From Sentient to TEKsystems

The Most Visible Bet

Sentient Technologies was the most visible attempt to build a business around evolutionary AI. Founded in 2007, it raised over $150 million from venture capital and applied evolutionary algorithms to trading, e-commerce optimization, and drug discovery. The company shut down its AI operations in 2018 after failing to commercialize the technology at scale.

Acquisition and Rebranding

Cognizant acquired Sentient's evolutionary AI intellectual property and team in 2018, rebranding the technology as Evolutionary AI within its Digital Business division. But the acquisition did not turn the technology into a core strategic asset.

A Feature, Not a Product

In 2022, Cognizant sold the Evolutionary AI assets and team to TEKsystems, a subsidiary of Allegis Group. TEKsystems integrated the technology into its data and analytics practice. This arc tells a clear story. Evolutionary AI did not become a product category that customers bought separately. It became a feature inside broader platforms. Google's AutoML, Amazon's SageMaker Autopilot, and Microsoft's Azure Automated ML all incorporate evolutionary search as one technique among many. The technology matters as part of a toolkit, not as a standalone market.

Where Evolutionary AI Fits in the AutoML Stack

Automating Away Human Bias

The broader push toward automated machine learning aims to reduce human bias in model design. AutoML systems search across algorithms, hyperparameters, and architectures to find the best model for a given dataset. Evolutionary algorithms are a natural fit for this search because they handle discrete choices, such as whether to add a convolutional layer or change the activation function, that are difficult for gradient-based optimization.

The Hidden Layer

Google's AutoML uses a combination of reinforcement learning and evolutionary search. Amazon's SageMaker Autopilot includes evolutionary feature selection. Microsoft's Azure Automated ML applies genetic algorithms to hyperparameter tuning. In each case, the user does not see the evolution. They see a button labeled Automatic Model Training.

Enduring Legacy

This is the enduring legacy of evolutionary AI. The techniques that Ingo Rechenberg and John Holland sketched in the 1960s are now running in production at the world's largest cloud providers. They are not a separate industry. They are a hidden layer inside the infrastructure that lets non-experts build models. That is probably a bigger impact than any standalone startup could have achieved.

Key Facts

  • Foundational researchers: Ingo Rechenberg (evolution strategies, 1960s), John Holland (genetic algorithms, 1960s)
  • Google Brain 2017 paper: Large-Scale Evolution of Image Classifiers: 450 GPUs for 7 days, evolved architectures rivaling human designs on CIFAR-10 and CIFAR-100
  • OpenAI 2018 paper: Evolution Strategies as a Scalable Alternative to Reinforcement Learning: trained deep networks with thousands of parallel CPU cores
  • Uber AI Labs 2017 paper: Deep Neuroevolution: genetic algorithms for Atari game playing, competitive with deep reinforcement learning
  • Sentient Technologies: Founded 2007, burned through over $150M VC, shut down AI operations 2018
  • Cognizant acquisition: Acquired Sentient's evolutionary AI IP and team in 2018, rebranded as Evolutionary AI
  • TEKsystems acquisition: Cognizant sold Evolutionary AI assets to TEKsystems (Allegis Group subsidiary) in 2022
  • Commercial outcome: Evolutionary AI absorbed into AutoML tools from Google, Amazon, and Microsoft; no standalone category emerged

About the author

, Editor

Kenneth Ma is the editor of LeadMonitor.ai, covering the companies, deals and policy decisions shaping business and technology markets.

View all 427 articles by Kenneth Ma  ·  Our editorial policy

Recent Stories

How to make money selling Canva templates

How to highlight text in Canva

How to print from Canva without quality loss

How to check if Canva is down right now

How to group and ungroup elements in Canva

How to stretch an image in Canva

How to make a QR code in Canva

Convert Canva to PowerPoint and Google Slides