esp-who/docs/en/get-started/ESP32-S3-EYE_Getting_Starte...

18 KiB
Raw Blame History

ESP32-S3-EYE v2.1

This user guide will help you get started with ESP32-S3-EYE v2.1 and will also provide more in-depth information.

The ESP32-S3-EYE is a small-sized AI development board produced by Espressif. It is based on the ESP32-S3 SoC and ESP-WHO, Espressifs AI development framework. It features a 2-Megapixel camera, an LCD display, and a microphone, which are used for image recognition and audio processing. ESP32-S3-EYE offers plenty of storage, with an 8 MB Octal PSRAM and a 8 MB flash. It also supports image transmission via Wi-Fi and debugging through a Micro-USB port. With ESP-WHO, you can develop a variety of AIoT applications, such as smart doorbell, surveillance systems, facial recognition time clock, etc.

ESP32-S3-EYE
ESP32-S3-EYE

The document consists of the following major sections:

1. Getting Started

1.1. Overview

The ESP32-S3-EYE board consists of two parts: the main board (ESP32-S3-EYE_MB) that integrates the ESP32-S3-WROOM-1 module, camera, SD card slot, digital microphone, USB port, and function buttons; and the sub board (ESP32-S3-EYE_SUB) that contains an LCD display. The main board and sub board are connected through pin headers.

1.2. Comparison with ESP-EYE

The ESP32-S3-EYE has some additional functions comparing to ESP-EYE, an ESP32-based development board. The comparison below covers key differences between the two boards:

Feature ESP32-S3-EYE ESP-EYE
Chip embedded ESP32-S3 ESP32
Memory 8 MB Octal PSRAM 8 MB Quad PSRAM
Storage 8 MB flash 4 MB flash
LCD display Yes None
Accelerometer Yes None
Alternative power supply External battery (optional) None
USB-to-UART bridge No need. Functionality is provided by ESP32-S3 USB Serial/JTAG interface. Yes
Antenna connector No need. Antenna is provided by the ESP32-S3-WROOM-1 module. Yes

1.3. Block Diagram

The block diagram below presents main components of the ESP32-S3-EYE_MB main board (on the left) and the ESP32-S3-EYE_SUB sub board (on the right), as well as the interconnections between components.

ESP32-S3-EYE Block Diagram
ESP32-S3-EYE Block Diagram

The following sections will describe the key components on the main board and the sub board, respectively.

1.4. Components on the ESP32-S3-EYE Main Board

ESP32-S3-EYE_MB - front and back
ESP32-S3-EYE_MB - front and back

The key components of the board are described from front view to back view, starting from the camera, in an anti-clockwise direction.

No. Key Component Description
1 Camera The camera OV2640 with 2 million pixels has a 66.5° field of view and a maximum resolution of 1600x1200. You can change the resolution when developing applications.
2 Module Power LED The LED (green) turns on when USB power is connected to the board. If it is not turned on, it indicates either the USB power is not supplied, or the 5 V to 3.3 V LDO is broken. Software can configure GPIO3 to set different LED statuses (turned on/off, flashing) for different statuses of the board. Note that GPIO3 must be set up in open-drain mode. Pull GPIO3 up can break the LED.
3 Pin Headers Connect the female headers on the sub board.
4 5 V to 3.3 V LDO Power regulator that converts a 5 V supply into a 3.3 V output for the module.
5 Digital Microphone The digital I2S MEMS microphone features 61 dB SNR and 26 dBFS sensitivity, working at 3.3 V.
6 FPC Connector Connects the main board and the sub board.
7 Function Button There are six function buttons on the board. Users can configure any functions as needed.
8 ESP32-S3-WROOM-1 The ESP32-S3-WROOM-1 module embeds the ESP32-S3R8 chip variant that provides Wi-Fi and Bluetooth 5 (LE) connectivity, as well as dedicated vector instructions for accelerating neural network computing and signal processing. On top of the integrated 8 MB Octal SPI PSRAM offered by the SoC, the module also comes with 8 MB flash, allowing for fast data access. ESP32-S3-WROOM-1U module is also supported.
9 MicroSD Card Slot Used for inserting a MicroSD card to expand memory capacity.
10 3.3 V to 1.5 V LDO Power regulator that converts a 3.3 V supply into a 1.5 V output for the camera.
11 3.3 V to 2.8 V LDO Power regulator that converts a 3.3 V supply into a 2.8 V output for the camera.
12 USB Port A Micro-USB port used for 5 V power supply to the board, as well as for communication with the chip via GPIO19 and GPIO20.
13 Battery Soldering Points Used for soldering a battery socket to connect an external Li-Ion battery that can serve as an alternative power supply to the board. If you use an external battery, make sure it has built-in protection circuit and fuse. The recommended specifications of the battery: capacity > 1000 mAh, output voltage 3.7 V, input voltage 4.2 V 5 V.
14 Battery Charger Chip 1 A linear Li-Ion battery charger (ME4054BM5G-N) in ThinSOT package. The power source for charging is the USB Port.
15 Battery Red LED When the USB power is connected to the board and a battery is not connected, the red LED blinks. If a battery is connected, the red LED turns on. When the battery is fully charged, it turns off.
16 Accelerometer Three-axis accelerometer (QMA7981) for gesture recognition, screen rotation, etc.

1.5. Components on the ESP32-S3-EYE Sub Board

ESP32-S3-EYE_SUB - front and back
ESP32-S3-EYE_SUB - front and back

The key components of the board are described from front view to back view, starting from the LCD display, in an anti-clockwise direction.

Key Component Description
LCD Display 1.3” LCD display, connected to ESP32-S3 over the SPI bus.
Strapping Pins Four strapping pins led out from the main board. They can be used as testing points.
Female Headers Used for mounting onto the pin headers on the main board.
LCD FPC Connector Connects the sub board and the LCD display.
LCD_RST LCD_RST testing point. You can use it to reset the LCD display with control signals.

1.6. Contents and Packaging

1.6.1. Retail Orders

If you order a few samples, each board comes in an individual box. Each box contains:

  • 1 x ESP32-S3-EYE_MB main board
  • 1 x ESP32-S3-EYE_SUB sub board

The main board and sub board are assembled by default.

For retail orders, please go to https://www.espressif.com/en/company/contact/buy-a-sample.

1.6.2. Wholesale Orders

If you order in bulk, the boards come in large cardboard boxes.

For wholesale orders, please go to https://www.espressif.com/en/contact-us/sales-questions.

1.7. Default Firmware and Function Test

Each ESP32-S3-EYE board comes with pre-built default firmware that allows you to test its functions including voice wake-up, command recognition, face detection and recognition.

To test the board's functions, you need the following hardware:

  • 1 x ESP32-S3-EYE
  • 1 x USB 2.0 cable (Standard-A to Micro-B), for USB power supply

Before powering up your board, please make sure that it is in good condition with no obvious signs of damage. Both the main board and the sub board should be firmly connected together. Then, follow the instructions described below:

  1. Connect the board to a power supply through the USB Port using a USB cable. While the board is powered up, you will notice the following responses:
  • The Module Power LED turns on for a few seconds, indicating that the default firmware is being loaded.
  • Once the firmware is loaded, the Module Power LED turns off.
  • The board enters human face recognition mode by default.
  • The LCD display shows live video streaming.

At this point, the board is ready for further instructions. You can control the board with either function buttons or voice commands. Function button control is described first:

  1. Face the camera so whole human face is visible on the screen for the board to detect. Once a human face is detected, the board displays a blue rectangle.
  2. Press MENU so that the board enters an ID (starting from 1) for a detected human face.
  3. Press UP+ so that the board starts face recognition. Once a face is recognized, the board displays the entered face ID. If it doesnt know the face, it displays “WHO?”.
  4. Press PLAY to delete the latest face ID. The board displays "XXX ID(S) LEFT".

To control the board with voice commands, follow the instructions below:

  1. Complete step 1 described previously and notice responses from the board.
  2. Activate the board with the default Chinese wake word “Hi, 乐鑫” (meaning "Hi, Espressif"). Note that only Chinese wake word is supported in the default firmware. When the wake word is detected, the Module Power LED should turn on, indicating that the board is ready for a speech command.
  3. In the default human face recognition mode, use the following three commands to control the board:
Default Chinese Speech Commands Meaning Response
添加人脸 Enter human face ID The board enters a human face ID
识别一下 Recognize human face The board displays a recognized human face ID, or "WHO?" for an unrecognized face.
删除人脸 Delete human face ID The board deletes the latest human face ID entered and displays "XXX ID(S) LEFT".
  1. To switch between four working modes that are supported in the default firmware, first wake up the board with wake word, then say the speech command for a working mode:
Speech Commands for Different Working Modes Meaning Response
人脸识别 Human face recognition The board displays a blue rectangle if a human face is detected.
移动侦测 Motion detection The board displays a solid blue rectangle in upper-left corner if motion is detected.
仅显示 Display only The board displays only live video streaming.
停止工作 Stop working The board does nothing and displays Espressif logo.

Now you get the first experience with the board. The following sections provide further information about how to flash firmware onto the board, configuration options, related resources, and more.

2. Start Application Development

This section provides instructions on how to do hardware/software setup and flash firmware onto the board for application development.

2.1. Required Hardware

  • 1 x ESP32-S3-EYE
  • 1 x USB 2.0 cable (Standard-A to Micro-B), for USB power supply and flashing firmware on to the board
  • Computer running Windows, Linux, or macOS

2.2. Optional Hardware

  • 1 x MicroSD card
  • 1 x Li-ion battery

Note

Be sure to use a Li-ion battery that has built-in protection circuit.

2.3. Hardware Setup

Prepare the board for loading of the first sample application:

Connect the board with the computer through the USB Port using a USB cable. The Module Power LED should turn on. Assuming that a battery is not connected, the Battery Red LED will blink.

Now the board should be ready for software setup.

2.4. Software Setup

After hardware setup, you can proceed with preparation of development tools. Go to the guide to ESP-WHO, which will walk you through the following steps:

  1. Get ESP-IDF which provides a common framework to develop applications for ESP32-S3 in C language.
  2. Get ESP-WHO which is an image processing platform that runs on ESP-IDF.
  3. Run Examples that are provided by ESP-WHO.

3. Hardware Reference

This section provides more detailed information about the board's hardware.

3.1. Notes on GPIO Allocations

Except for GPIO3 that can be used to configure LED statuses, all GPIOs of the ESP32-S3-WROOM-1 Module have already been used to control specific components or functions of the board. If you would like to configure any pins yourself, please refer to the schematics provided in Section Related Documents.

3.2. Notes on Power Distribution

3.2.1. Independent Module and Camera Power Supply

The ESP32-S3-EYE board features independent power supplies to the camera and the remaining components. This should reduce noise in the audio signal from module components and improve overall performance of the components.

ESP32-S3-EYE - Module Power Supply
ESP32-S3-EYE - Module Power Supply
ESP32-S3-EYE - Camera Power Supply
ESP32-S3-EYE - Camera Power Supplies

4. Hardware Revision Details

This is the first revision of this board released.

5. Related Documents

5.1. Datasheet

5.2. Schematic

5.3. PCB Layout

5.4. Dimensions

For further design documentation for the board, please contact us at sales@espressif.com.