Skip to content

History interview questions

The people, papers and moments that built the field, from the perceptron to the Transformer.

34 questions in this category.

The cards run from least squares and Bayes through the perceptron, backpropagation and MNIST to AlexNet, AlphaGo and the Transformer: the papers, datasets and people whose names turn up in interview small talk, and in the citations behind everything else in the deck.

Start with these

  1. Who invented the perceptron?
  2. When was the Turing Test created?
  3. Who envisioned and created the ImageNet dataset?
  4. Who are known as the "Godfathers of AI"?
  5. What is the name of the computer program that first beat a professional Go player without a handicap?

The mathematical roots, 1763 to 19134 questions

Machine learning's oldest ideas come from probability and astronomy: Bayes' theorem, published in 1763 after his death, Legendre's least squares in 1805, Laplace's 1812 treatise on probability, and Markov's chains, first applied to real data in 1913.

Was Bayes's Theorem published after his death?
Yes. Bayes died in 1761, and his friend Richard Price edited his essay and presented it to the Royal Society in December 1763, two years later. Pierre-Simon Laplace, working independently, stated the same principle in 1774 and developed it further over the following decades, notably in his Théorie analytique des probabilités (1812).
In 1812 Laplace published "Théorie analytique des probabilités", in which he stated a famous theorem. Which theorem was it?
Bayes' theorem, which Laplace had found independently in 1774 and set out here as a general principle for inferring causes from observed events. The same book is also known for Laplace's central limit theorem.
Andrey Markov first described the techniques he used to analyse a poem, and these techniques later became known as Markov chains. True or false?
False as stated. Markov introduced the chains in a 1906 paper on the law of large numbers for dependent variables. His 1913 study of vowel and consonant sequences in the first 20,000 letters of Pushkin's Eugene Onegin was their first application to real data, not their origin.

Early AI and the first neural networks, 1950 to 19897 questions

From Turing's test in 1950 and the first neural network machine a year later, through the perceptron and the reverse-mode differentiation behind backpropagation in 1970, to LeCun's convolutional networks and Watkins's Q-learning, both from 1989.

When was the Turing Test created?
1950, in Turing's paper "Computing Machinery and Intelligence", which swapped the question of whether machines think for an imitation game judged over text. Its weakness is that it rewards convincing conversation rather than understanding — a critique now aimed straight at LLMs.
When was the nearest neighbor algorithm created?
1951: Evelyn Fix and Joseph Hodges introduced nearest neighbor classification in a US Air Force report. The often-quoted 1967 is Thomas Cover and Peter Hart's paper proving that 1-NN's error is at most twice the Bayes error.
Who invented the perceptron?
Frank Rosenblatt. Bonus. The invention of the perceptron generated a great deal of excitement and was widely covered in the media.
In 1970 Seppo Linnainmaa described reverse-mode automatic differentiation in his master's thesis. This corresponds to the modern version of:
Backpropagation — reverse-mode automatic differentiation, which gets the gradient of a scalar loss with respect to every parameter in roughly one backward pass. Rumelhart, Hinton and Williams rediscovered and popularised it for neural networks in 1986.
Who is known as the founding father of convolutional nets?
Yann LeCun, who at AT&T Bell Labs in 1989 first trained convolutional networks end to end with backpropagation (later LeNet). The architecture builds on Kunihiko Fukushima's 1980 neocognitron.

Machine learning grows up, 1990 to 200911 questions

The decades when statistical learning took over: the R language, random forests, support vector machines and the LSTM, Deep Blue's chess win, the MNIST digits, early deep learning libraries like Torch and Theano, and ImageNet, the dataset that set up the deep learning boom.

Who are credited with the creation of R?
Ross Ihaka and Robert Gentleman.
Who invented the LSTM architecture in deep learning?
Sepp Hochreiter and Jürgen Schmidhuber in 1997.
What was the name of the first computer to beat a reigning world chess champion?
Deep Blue, built by IBM. It won a game against Garry Kasparov in 1996 but lost that match, then won the 1997 rematch 3½-2½.
When was Torch released?
2002, when Ronan Collobert, Samy Bengio and Johnny Mariéthoz at IDIAP described the C++ library. The better-known Lua-based Torch7 followed in 2011.
Who coined the term deep learning in 2006?
Geoffrey Hinton is usually credited: his 2006 deep belief net paper with Osindero and Teh made the term popular. Strictly, he didn't coin it. Rina Dechter used "deep learning" in 1986, and Igor Aizenberg and colleagues applied it to neural networks in 2000.
Who envisioned and created the ImageNet dataset?
Fei-Fei Li, who argued from 2007 that models were starved of data rather than ideas and used crowdsourced labelling to reach roughly 14 million images across 20,000+ categories. The 2012 ILSVRC contest run on it is where AlexNet made deep learning mainstream.

The deep learning era, 2012 to 201710 questions

From AlexNet's ImageNet win in 2012 to the Transformer in 2017: GANs, the frameworks people still use (TensorFlow, Keras and PyTorch), and AlphaGo's wins over Fan Hui and Lee Sedol, the second one run on Google's TPUs.

What language was the original AlexNet (ILSVRC 2012) written in?
CUDA and C++, in Alex Krizhevsky's cuda-convnet code, with Python scripts driving training.
What is the name of the computer program that first beat a professional Go player without a handicap?
AlphaGo, by Google DeepMind. It beat European champion Fan Hui 5-0 in October 2015, the first win by a computer over a professional on a full 19 × 19 board without handicap.
What was the output dimension of the embedding layers and sub-layers of the original Transformer (Attention Is All You Need, 2017)?
512 (d_model) in the base model. The larger Transformer (big) in the same paper used 1024.

The people2 questions

Geoffrey Hinton, Yann LeCun and Yoshua Bengio, who shared the 2018 Turing Award for deep learning, and the students who learned from them.

Who are known as the "Godfathers of AI"?
Geoffrey Hinton, Yann LeCun and Yoshua Bengio, the three researchers whose work underpins modern deep learning. They shared the 2018 ACM Turing Award for making deep neural networks a critical component of computing.
Whose notable students include Ruslan Salakhutdinov, Ilya Sutskever and Yann LeCun?
Geoffrey Hinton. Salakhutdinov and Sutskever did their PhDs with him at the University of Toronto; LeCun was his postdoc there from 1987 to 1988.

Created by santiviquez

About · Quizzes · History of AI · To suggest new questions or report an error send me a dm.