Guide to Set Up THSCU101 with NVIDIA Jetson Nano

Introduction

USB Cameras are so common these days that people may think once any of them is connected to any computer through the USB connector it automatically works. This is not always true. For example, if you are connecting  a high resolution and high performance USB camera to a Linux-based computer, it is likely you will encounter issues due to the need for many coding jargons to connect it successfully.

This page will avoid these issues  by guiding you to quickly and successfully stream video from THine Solutions’ THEIA-CAM™ THSCU101 (13MP PDAF USB Camera) using an NVIDIA Jetson Nano Developer Kit!

Hardware Overview

NVIDIA Jetson Nano Developer Kit

Any NVIDIA Jetson Nano Developer Kit should work, but we recommend to use the 5V 4A barrel jack power supply instead of Micro-USB. We have tested and confirmed the following brands:

• Adafruit

• Makeronics

Internet access will be needed to download all the files. You will need to either use Wi-Fi, if your Jetson Nano has Wi-Fi access, or you will need a LAN cable to connect the Jetson Nano to your Router.

THine Solutions THEIA-CAM THSCU101

The THSCU101 is available at Digi-Key. A USB 3.0 Micro-B to Type A cable is included in the THSCU101 Kit.

We will now show you how to easily stream 4K camera video with Phase Detection Auto Focus!

Before You Start..

Make sure your THSCU101 Firmware is up to date. How to check the version numbers and to replace with the latest Firmware is explained here for Windows. For Mac, THSCU101 Firmware Programming Tool for Mac.

Driver Installation

Download the File

The ‘ignition key’ is here. Place the zip file “THEIA-CAM.zip“ on Desktop of the Jetson Nano.

Install the Drivers

Unzip and place the folder in Desktop by launching the Terminal window and executing following commands:

cd Desktop

unzip THEIA-CAM.zip

ls

Now you see a folder on the Desktop with multiple resolution choices.

Now, let’s get the latest data and install. You may be asked to enter password for your user ID for Jetson Nano, and also if you want to continue. Type “y” and hit [Enter].

cd THEIA-CAM

chmod +x ./*.csh

./install.csh

Start Streaming

Now, your Jetson Nano is ready to stream images. Make sure your THSCU101 is connected to your Jetson Nano, and try 1080p 30fps YUV.

./1080p30.csh

Voila! Do you see another window comes up showing live images? You might want a tripod to have your THEIA-CAM™ so she (note: “Theia” is a goddess name) can look at what you want her to. If the image is not clear, double check if you have removed the transparent protector on top of the 13MP PDAF sensor module. Ctrl+C to close the video streaming window.

You can stream different resolution, frame rate, and data format by selecting one of the command files as below.

./1080p30.csh

./1080p60.csh

./3M.csh

./4K.csh

./13M.csh

Multi-Camera Setup on Jetson Nano

The scripts you have support multiple cameras.

v4l2-ctl —list-devices

Will tell you what cameras your Jetson Nano is connected to, e.g., /dev/video0, /dev/video1, /dev/video2….

Once identifying the address, add “ /dev/video<n> to the video stream commands. For example, for /dev/video1, your commands will be:

cd Desktop

cd THEIA-CAM

./1080p30.csh /dev/video1

./1080p60.csh /dev/video1

./3M.csh /dev/video1

./4K.csh /dev/video1

./13M.csh /dev/video1

By opening another Terminal window, you can see each video stream.

What’s Next - Want to Tweak the Image Quality?

We are confident and proud of the Image Quality of the THEIA-CAM™ THSCU101. With Imatest criteria, the THSCU101 does perform better than iPhone 12 in most areas. However, different application requires different specs. If you need to change THEIA-CAM’s configuration, there are several options listed as below.

UVC (USB Video Class) Configuration

Under years of close partnership with Cypress Semiconductor, an Infineon company, THSCU101 supports whole bunch of configuration set for UVC (USB Video Class) commands through Cypress’ CX3.

CDK (Camera Development Kit) tool to develop your own ISP firmware

From driving a CMOS image sensor, processing standard image such as Auto Exposure and Auto White Balance, and then Image Quality tuning in multiple different light conditions, to unit-to-unit Image Quality calibration against CMOS image sensor modules, an Image Signal Processor (ISP) covers everything that is related to image/video that Application Processor takes as the camera image output. Because the process, structure, and the firmware to execute all the computing, ISP’s process design is typically so closed and confidential that you cannot touch. THine’s ISP is the exception.

THine has developed a took set CDK (Camera Development Kit), that enables you to do the ISP firmware development for all the essential functions according to your own program requirements, with easy-to-use Graphical User Interface.

If CDK overview is found cover your program requirements, contact us and request for technical support. According to your application and requirements, we will tailor our support along with CDK took kit.

Related Pages

Product Overview | THSCU101 13MP PDAF UVC Camera | THine Solutions, Inc.

Image Quality Report | THSCU101 Image Quality Report | THine Solutions, Inc.

Whitepaper | Design Trend for Embedded Vision Systems that Include High Performance Cameras | Katsumi Kuwayama | THine Solutions, Inc.

Blog | Upgrade to PDAF for Best Auto-Focus Experience! | Tak Iizuka | THine Solutions, Inc.

Product Overview | THEIA-CAM - 13MP PDAF UVC Camera Reference Design Kit (RDK) | Cypress Semiconductor Corp.