Home Original page

GitHub - mriamnobody/DeepCamera: Empower any camera/CCTV with state of the art AI, including facial recognition, person recognition(RE-ID) car detection, fall detection and more

Empower camera with SOTA AI
ML pipeline for AI camera/CCTV
Easy to use Edge AI development

GitHub release Pypi release Monthly download


DeepCamera empowers your traditional surveillance cameras and CCTV/NVR with machine learning technologies. It provides open source facial recognition based intrusion detection, fall detection and parking lot monitoring with the inference engine on your local device.

SharpAI-hub is the cloud hosting for AI applications which help you deploy AI applications with your CCTV camera on your edge device in minutes.

Empower any camera with the state of the art AI

  • facial recognition
  • person recognition(RE-ID)
  • parking lot management
  • fall detection

ML pipeline for AI camera/CCTV development

  • feature clustering with vector database Milvus
  • labelling with Labelstudio

Easy to use Edge AI development environment

  • AI frameworks in docker
  • desktop in docker with web vnc client, so you don't need even install vnc client

Install SharpAI-Hub CLI

pip3 install sharpai-hub

Self-supervised person recognition(REID) intruder detection

SharpAI yolov7_reid is an open source python application leverages AI technologies to detect intruder with traditional surveillance camera. Source code is here

It leverages Yolov7 as person detector, FastReID for person feature extraction, Milvus the local vector database for self-supervised learning to identity unseen person, Labelstudio to host image locally and for further usage such as label data and train your own classifier. It also integrates with Home-Assistant to empower smart home with AI technology.

Deploy yolov7_reid with sharpai-hub CLI

pip3 install sharpai-hub
sharpai-cli yolov7_reid start

If you are using Windows, you can use following command line to start yolov7_reid application

python3 -m sharpai_hub.cli yolov7_reid start

Then please following the instruction which sharpai-cli provides.
The yolov7 detector is running in docker, you can access the docker desktop with http://localhost:8000

Home-Assistant is hosted at http://localhost:8123
Labelstudio is hosted at http://localhost:8080

DeepCamera Facial Recognition local deployment

We received feedback from community, local deployment is needed. With local deepcamera deployment, all information/images will be saved locally.
sharpai-cli local_deepcamera start

DeepCamera Facial Recognition cloud deployment for free

  • Register account on SharpAI website
  • Login on device: sharpai-cli login
  • Register device: sharpai-cli device register
  • Start DeepCamera: sharpai-cli deepcamera start

Laptop Screen Monitor for kids/teens safe

SharpAI Screen monitor captures screen extract screen image features(embeddings) with AI model, save unseen features(embeddings) into AI vector database Milvus, raw images are saved to Labelstudio for labelling and model training, all information/images will be only saved locally.

sharpai-cli screen_monitor start

Access streaming screen: http://localhost:8000

Access labelstudio: http://localhost:8080

SharpAI-Hub AI Applications

SharpAI community is continually working on bringing state-of-the-art computer vision application to your device.

sharpai-cli <application name> start
Application SharpAI CLI Name OS/Device
Laptop Screen Monitor screen_monitor Windows/Linux/MacOS
Facial Recognition Intruder Detection deepcamera Jetson Nano
Local Facial Recognition Intruder Detection local_deepcamera Windows/Linux/MacOS
Parking Lot monitor yoloparking Jetson AGX
Fall Detection falldetection Jetson AGX

Tested Devices

Edge AI Devices / Workstation

Tested Camera:

  • DaHua / Lorex / AMCREST: URL Path: /cam/realmonitor?channel=1&subtype=0 Port: 554
  • Ip Camera Lite on IOS: URL Path: /live Port: 8554
  • Nest Camera indoor/outdoor by Home-Assistant integration

Support

  • If you are using a camera but have no idea about the RTSP URL, please join SharpAI community for help.
  • SharpAI provides commercial support to companies which want to deploy AI Camera application to real world.

Click to join sharpai slack channel

DeepCamera Architecture

architecture

DeepCamera Feature List

Commercial Version

  • Provide real time pipeline on edge device
  • E2E pipeline to support model customization
  • Cluster on the edge
  • Port to specific edge device/chipset
  • Voice application (ASR/KWS) end to end pipeline
  • ReID model
  • Behavior analysis model
  • Transformer model
  • Contrastive learning
  • Click to join sharpai slack channel for commercial support

FAQ

How to install python3

How to install pip3

How to install Docker-compose on Jetson Nano

sudo apt-get install -y libhdf5-dev python3 python3-pip
pip3 install -U pip
sudo pip3 install docker-compose==1.27.4

How to use web gui

How to config RTSP on GUI

Camera streaming URL format

How to create token for Telegram Bot(DOC W.I.P)

  • Create Telegram Bot through @BotFather
  • Set Telegram Token in Configure File
  • Send message to the new bot you created

Contributions