History of AI

What was DENDRAL, and why is it called the first expert system?

· By Robert Scales · 5 min read

Short answer

DENDRAL was a research project begun at Stanford University in 1965 that built a computer program to work out the structure of unknown organic molecules from mass spectrometry data, the way a trained chemist would. It is called the first expert system because its strength came from a large store of a specialist's knowledge, written down as rules, rather than from clever general-purpose reasoning.

Most early AI programs tried to be generally clever: prove theorems, play games, solve puzzles. DENDRAL went the other way. It picked one narrow, hard, real scientific job and tried to do it as well as a skilled human. The job was identifying an unknown chemical compound, and the program's power came from what chemists knew, carefully copied into it.

The project began at Stanford University in 1965. Joshua Lederberg, a Stanford scientist, wanted computers that could help him study organic molecules for his exobiology research (the search for life beyond Earth). He was not a chemist or a programmer, so he teamed up with the Stanford chemist Carl Djerassi and the computer scientist Edward Feigenbaum. Georgia Sutherland wrote the first version of the program in Lisp, and Bruce Buchanan joined to extend it. The name comes from "Dendritic Algorithm," Lederberg's method for listing molecular structures like the branches of a tree.

The problem DENDRAL tackled

A mass spectrometer is a laboratory instrument. You put in a tiny sample of a compound, it smashes the molecules with electrons, and it records the pieces that fly out. The result, the mass spectrum, is a chart: each point shows the mass of a fragment and how much of it appeared.

From that chart, a chemist has to work backward to the shape of the original molecule. The difficulty is that even a modest chemical formula can be assembled in a huge number of ways. A team memo from November 1969 describes the goal plainly: given the spectrum of an unknown compound, produce a short list of plausible candidate structures, then pick the one whose predicted spectrum best matches the data.

The team saw this as a model of scientific thinking. Scientists guess an explanation (induction), then check what that explanation predicts (deduction). DENDRAL was meant to imitate both steps in a small, well-defined corner of science.

How it worked: plan, generate, test

The 1969 memo breaks Heuristic DENDRAL, the main program, into three stages. Here they are with a simplified example.

StageWhat the program doesEveryday analogy
1. Plan (preliminary inference)Reads clues in the spectrum and lists chemical groups that might be present and groups that cannot beA detective rules suspects in or out from the first clues
2. GenerateBuilds every structure that fits the formula and respects those two lists, with no duplicatesWriting out every remaining suspect's possible story
3. Test (predict)Predicts a spectrum for each candidate and ranks them by how well it matches the real oneChecking each story against the evidence

The planning stage kept two lists, which the program called GOODLIST and BADLIST. A group on the good list was treated as a single "super atom" that had to appear in every candidate, and anything on the bad list was forbidden. That one trick cut the number of structures to consider enormously. The generator itself rested on Lederberg's algorithm, which was designed to produce a complete list of possible structures for a formula without repeating any.

The key word is "heuristic." A heuristic is a rule of thumb: it does not guarantee the right answer, but it throws away unlikely options so the search stays manageable. Most of the program's ingenuity, the authors wrote, went into these shortcuts rather than into the generator.

Try it: Take the letters A, B, C and D and list every four-letter order (there are 24). Now add two "chemist's rules": B must come right after A, and D cannot be first. Count how many orders survive. You have just done DENDRAL's plan and generate steps by hand.

How well did it do?

In July 1969, Djerassi set his graduate seminar in mass spectrometry three spectra to interpret, giving the students exactly the information the program received. On the first problem, the program and one student got the right answer. On the second, the program was correct while the humans were partly right or wrong. On the third, the program missed. It took two to five minutes per problem; the chemists took fifteen to forty. The team reported that experts judged it about as good as graduate students and postdoctoral researchers within its narrow task.

The memo is just as frank about the hard part. The biggest bottleneck was getting the knowledge out of the chemists. There was no tidy textbook theory of mass spectrometry to copy. A programmer who was not a chemist spent many hours questioning the experts, and rules often had to be written, tested and rewritten several times. The authors also learned to keep the chemical knowledge separate from the code that used it, so the rules could be changed without rewriting the program.

Why it mattered

That lesson is DENDRAL's lasting contribution. It showed that a program could reach expert-level performance by holding a lot of specific knowledge, and it gave a name to the work of extracting that knowledge: knowledge engineering. A later program, Meta-DENDRAL, went a step further and tried to propose new rules of mass spectrometry from examples, an early form of machine learning.

The approach spread. Feigenbaum's group at Stanford went on to MYCIN, which diagnosed infections, and other systems such as PROSPECTOR and XCON followed the same pattern. In the 1980s, expert systems became a business, and a large share of big companies reportedly used them. The same weakness kept appearing, too: capturing an expert's knowledge is slow and expensive, a difficulty known as the knowledge acquisition problem. The ELIZA and expert systems overview on this site follows that story further.

How is DENDRAL different from the machine learning systems of today?

DENDRAL's knowledge was written by people. Chemists explained their reasoning, programmers turned it into rules, and the program applied them. You could open it up and read why it rejected a structure. Today's most talked-about systems, such as the deep neural networks behind image recognition and translation in 2019, mostly work the other way: they are shown many examples and adjust millions of internal numbers until their answers improve. Nobody writes their rules, and they are much harder to inspect.

Each approach has a price. DENDRAL needed scarce expert time but could explain itself. A learned model needs large amounts of data but no expert interviews. Meta-DENDRAL is a reminder that the two ideas met early: early on, the Stanford team wanted a program that could discover rules on its own, not just follow the ones it was given.

Sources

  1. A Heuristic Program for Solving a Scientific Inference Problem: Summary of Motivation and Implementation — Joshua Lederberg, Georgia L. Sutherland, Bruce G. Buchanan, Edward A. Feigenbaum; Stanford Artificial Intelligence Project memo (Stanford University Libraries, Feigenbaum papers)
  2. Dendral — Wikipedia (revision of April 7, 2018), April 7, 2018
  3. Expert system — Wikipedia (archived May 2019), May 1, 2019

Get the free Guide to Artificial Intelligence

Sign up for the weekly newsletter and receive the free guide: what changed in AI this week, one lesson, one prompt to try. Unsubscribe in one click.

How we handle your address

Back to top

Display

Your choices are saved in this browser only. No data is sent.

Text size
100%
Colours
Reading
More settings
Accessibility statement