Some keen observers may have noticed that the Vision Sensor has been out of stock for awhile. We’ve been hard at work on a new and improved version, and I’m happy to finally announce its replacement, the AI Vision Sensor!
The VEX AI Vision Sensor is an exciting new addition to VEX V5 and EXP, providing powerful object detection capabilities. With AI object detection of various game objects, AprilTag detection, and color blob detection, this sensor elevates your VEX robot potential both in the classroom and on the competition field.
Features:
Color blob detection of up to 7 colors at once
Color code detection
AI object detection of generic VEX Classroom Game objects (Cube, Buckyball, Ring)
AI object detection of VEX Robotics Competition game objects (starting 2024-25)
AprilTag detection. Printable AprilTag will be available soon!
Notes:
Works with VEXcode EXP, VEXcode V5 and Visual Studio Code Extension
Color & Color Codes supported now in Blocks, Python and C++
AI and AprilTags supported in Python and C++. See VEX Library article upon release for more information
AI and AprilTags support coming to VEXcode Blocks with future software update
Legal*, yes.
V5 vexos 1.1.3 already supports it.
VEXCode for EXP and V5 will be out later today.
VS Code extension will be updated soon.
*from the manual
<R21> New VEX parts are legal. Additional VEX components released during the competition season on www.vexrobotics.com are considered legal for use unless otherwise noted.
Thank you I was just looking for confirmation on that since it would be an update in the software side. The other reason I was asking was that announcement said something about 24/25 season.
The aivision sensor includes an AI model for detecting certain objects used in a classroom setting. Later this year a new model will be available that will have next years game objects, ie. objects for the 24-25 season.
The data sent back to the brain is similar to the vision sensor, working resolution for objects is 320 x 240.
The sensor can stream video over USB like a webcam, that stream is 640x480.
This sensor does not have any WiFi.
Sounds like it is built to look at objects on the ground near the camera. There is a gameplay use for this, but it is limited – generally overcome with mechanical systems that account for variance in object placement.
Will this version have the same issues as the old vision sensor in detecting high, distant objects with a chaotic background in multiple lighting scenarios? Spin up goals or turning point flags were difficult to detect. Teams rarely use the vision sensor, due to the limited use case. Is there some software improvement that addresses the distant target issue?
I am not looking to add more unused sensors to my collection.
What do you mean with the word “too”?
I was under the impression that raw vision information was inaccessible from all of the vex sensors. Or are you just talking about a completely different system, unrelated to vex?
Really neat!
First question, is this the final form of the VEX AI Stereo Camera Sensor, or is this a separate product and that product remains under development?
See VEX Library article for more information
Is there a link to the VEX Library articles for this product? I wasn’t able to find any with a quick look.
Awesome!!! Really looking forward to potential future games with AprilTags on game and field elements.
What’s the word on user-modifiable object detection/fine tuning here? I’m guessing the object detection will come from VEX tuned generally to perform “well” across as many situations and circumstances as possible, but might be less than ideal in some situations (as is visible in the product video, with detections flickering in and out). So it would be useful for students to be able to fine-tune the detection to their needs.
Is Partner SDK support coming soon? Or is support already there int he partner SDK and partners need some time to add support on their end?
probably not until much later this year, the PROS team wasn’t even aware we were developing this. We have many non-competition customers that needed a replacement for the vision sensor which has been the priority.
Never give up do you Charles.
We have no immediate plans, but this product has far more potential than the old vision sensor so you never know.
Makes sense. Looking forward to the VEX AI Stereo Camera! Since this product effectively replaces the Vision Sensor, is there going to be an equivalent replacement released for the IQ system?
Unfortunate, I hope it can be added soon enough for the Partner teams (PROS and Mathworks) to add their own support before the competition season gets going.
I was referring to everything that openCV can interact with like other webcams, and if this was a member of that ‘list’ I guess you could call it of devices.
