Note that the y-axis in the measurement data is voltage and the x-axis is time. The higher the measurement signal is the more there are electrons in the corresponding MIG. If you have any questions about the video please feel free to post a comment.

Please check out our presentation about the 1T MIG pixel concept.

There has been some debate whether or not anyone needs 41 MP in their cameras, but that’s just pointless. The idea of putting 41 MP into a mobile phone camera is not to produce 41 MP images, the output images have only 5 MP by default. Oversampling is used to reduce image noise, problems related to Bayer color filters and of course to introduce digital zoom. The camera has it’s own dedicated processor to digest the huge amount of data from the sensor. It can deliver full HD 1080p 30fps with 4x loss-less zoom.

Nokia 808 PureView has just set the benchmark for future mobile phone cameras.

Jussi Seppälä

It is a very common problem that Scalado aims to solve with their object removal technology. The idea is simple, their app takes several images from the scene and detects all moving objects and a static background. Nice part is that they don’t just extract the static background but they let the user select which objects they want to keep in the image.

Besides comparing different readout methods, the simulator can be used for many different purposes. Students can use it as a learning tool to study how different noise components and image sensor parameters affect the image quality in various lighting conditions. Professionals can compare how different image sensors could perform in their application. Photographers can use it to get deeper understanding of digital image formation process.

The simulator should work with newest versions of most popular desktop browsers. Please feel free to use the simulator for whatever purpose!

Pixpolar

Images taken in low light with present technology include a tradeoff between two artifacts: image noise and image blur. In the below figures you can see two example pictures. The left one has lots of image noise and the right one is blurry. The blurry image is not easy on eyes and if you look at it long enough you will most probably get a headache. The image with lots of noise is easier to look at, and if you must decide, you would probably go for noise instead of blur. That’s also the most probable decision that the automatic mode of any present camera would make.

The noise is not a problem if the signal is large enough, it’s the signal-to-noise ratio that matters. In photography, the more light is captured the larger the signal is and the better the resulting signal-to-noise ratio is. Now the question is, how can you capture lots of light in low light? The answer is that you increase the exposure time, but, as most things in life, increasing exposure time has its side effects. To get a sharp image using a long exposure time your camera and the subject you are trying to capture should be relatively still during the whole exposure. If your camera has an image stabilizer the pitch and yaw motion can be compensated, at least to some degree, but it cannot correct camera roll motion or subject movement.

One way to avoid image blur with long exposure times is to divide the long exposure time into shorter intervals, i.e., to take multiple pictures with fast shutter speeds. Each image would be sharp, but the signal-to-noise ratio would be relatively low. When they all are combined using intelligent software, the signal-to-noise ratio can be improved substantially. There are already some cameras that utilize this idea, for example Sony’s NEX-5 (review here).

Whereas Sony is implementing image blur correction algorithms into their cameras, Adobe has developed a post processing algorithm that can correct image blur (video here). As the processing power in hand held devices is constantly increasing, the future of computational photography looks really interesting.

Jussi Seppälä

P.S. We made an html5 application to demonstrate the idea of using NDCDS readout to correct image blur. The app was made for Pixpolar’s demonstration needs and therefore it’s not optimized for many different platforms. You can check it out if you have an html5 ready browser running on a relatively powerful desktop environment. Have fun with our demonstrator!

Pictures taken with conventional cameras are two dimensional light intensity maps. Light field pictures include also information of the directions of the light rays which can be used in several ways:

- The focus of an image can be set to any distance or the whole image could be made sharp.
- One can measure the distance of the objects in an image that enables 3D modeling.
- Objects in any given distance from the camera could be cropped out easily.
- etc.

Light field imaging will change the way we use cameras and digital images. The development of this technology is early in it’s life cycle and it will take some time until it will replace conventional cameras. One major area that needs to be improved is the resolution.

During the past decade, the number one selling point of digital cameras has been the number of pixels in the image sensor. Lytro says that their camera can capture 11 megarays. It most probably means that they have 11 mega pixel sensor in their camera. What it doesn’t mean is that the images will have 11 mega pixel resolution.

Light field cameras include a lens array and the number of those lenses determine more or less the end image resolution. Behind each lens in the lens array there is some amount of pixels which are used for determining the direction of the light rays. For example, with 11 mega pixel image sensor and with 25 pixels reserved for each lens in the lens array the picture resolution would be 0.44 megapixels only.

In this manner to have a HD resolution picture with a light field camera one would need to have approximately 92 megapixel sensor (720 x 1280 x 4 x 25 = 92.16M). Have you seen one for sale? I haven’t.

For sensor manufacturers light field imaging means that the pixel race is not over and it will become even more important when light field imaging starts to get more consumer attention.

Scaling down pixels in conventional CCD and CMOS image sensor technologies means that the performance is severely compromised due to cross talk, dynamic range and other issues. Totally new image sensor technologies are therefore required to utilize the full potential of light field imaging.

It looks like there will be interesting times ahead for us enthusiastic photographers.

Jussi Seppälä