Vision Sensor RGB Values

Is it possible to read the rgb values of each pixel from the vision sensor (perhaps in a 2d array)? I looked at the API and did not see any method that enables that, but I was thinking that internally, VEX would likely be receiving and using such data.

In general, for sensors, is it possible to receive access to lower level functions or structures? I think it could allow for new and interesting algorithms tailored to specific competitions.