Project

Phone orders for a restaurant

A phone assistant that takes a spoken order and enters it on the restaurant's own online ordering page, which has no API.

Restaurants

Project snapshot

Industry
Restaurants
Input modalities
A phone callThe restaurant's online ordering page

Situation

The situation

A phone order needs someone to answer the call and enter the order. The restaurant's ordering system had no API to connect to.

The build

What I built

I built an assistant that listens to the caller, replies by voice, and fills in the restaurant's ordering page in a browser, one step at a time.

In use

What it does

  • The caller says the order and the assistant replies by voice.
  • The assistant adds the items on the ordering page and moves to checkout.
  • No API was needed. The assistant uses the same page a customer would.

In detail

A closer look at the problem and how the build works.

The situation

Taking a phone order ties up a person: answer the call, hear the order, enter it. The restaurant's ordering system offered no API, so there was nothing to connect a phone assistant to.

What I built

I built an assistant that uses the ordering page the way a customer does. It turns the caller's speech into text, works out the order, and replies by voice.

How it works

  • The caller says what they want.
  • The assistant opens the ordering page in a browser and adds the items.
  • It moves through the page to checkout.
  • When the page asks for something only the caller has, such as a verification code, the assistant asks for it on the call.