Monday, September 22, 2008

Live View & AF Methods Fully Dissected

Introduction

For quite a while, there has been a new trend for DSLRs to have the Live View (LV) function. Despite some people would question the usefulness of the LV, it would be interesting to learn that “What does a Live View screen add to a DSLR?”, just read that article to have some ideas.

In short, Live View opens up new photo opportunities and it could be an invaluable tools for more shooting flexibility and for new creative compositions which would have never been possible without Live View but only with special, expensive or bulky accessories for finder optics (which are yet not as versatile).

The Basics (Working Principles and Pros & Cons)

1. Live View CMOS Imagers (for DSLRs)



As we all know, the CCD and CMOS Imagers used in DSLRs are much larger in size and area than those used in smaller DCs for P&S shooters. The design of those DSLR imagers are somehow quite different than those smaller imagers from the very beginning as all DC imagers were capable to do LV on day one. In contrast, DSLR imagers are designed to have the highest possible overall picture quality which means higher pixel count, larger photo site / pixel area, wider dynamic range, lower noise at higher ISO sensitivities and so on.

Until Olympus created the E-330 in January 2006 with a brand new “Live MOS” sensor, the DSLR imagers started to be LV capable.

So, what makes a sensor to be LV capable. There exists a number of criteria for the imager to fulfil, namely:-

  • High enough refresh rate – so that the LV display can be updated seamlessly as viewed, say, at least more than 25 fps;
  • Not generating much heat during LV and/or to dissipating the heat quickly and efficiently/effectively enough;
  • Need to have a short and fast reset after leaving the LV and be prepared to take the actual image. The reset is a discharge process where the shutter need to be closed and let all the stored charge in all pixels of the imager to be drained. Anyway, no matter how fast or slow the discharge process is, it just means there will be a *delay* time to be waited.
But then the problem is, when the camera is doing LV using the imager, the mirror must be lifted up during the whole LV process, thus losing the Phase Matching/Detection AF (See more of my brief explanations below) capability. If the Phase Matching AF is the only means to measure and achieve the focus, then the LV must be stopped if AF is required. As such, the mirror is lowered so that the Phase Matching Detection AF system can be used again.

The BIGGEST Advantage of using imager as the LV sensor is that it is simply WYSIWYG (What You See Is What You Get), which just means previewing the whole image 100% in area is possible and the user could preview other picture effect clearly and accurately such as the exposure and colours, focus, Depth of Field (DoF) and so on.

As for DCs, the exposure control for the displayed LV image (brightness) could be achieved by dynamic aperture opening and/or electronic shutter of the imager itself. I have no information about how different (brands of) DSLRs control this and their means, though. But some DSLRs are better implemented than others and in general, the later the product, the more mature the LV is.

There is so far no larger CCD Imager for DSLR, unlike those very small CCDs for P&S DCs which all have such LV function (and of course, as said before).

2. Separate Live View Sensor in the Optical ViewFinder



As seen from these two diagrams for the E-330, the working principle is to split some light from the optical viewfinder image to the "Full-time" LV Sensor, but it should be noted that it is NOT exactly WYSIWYG. Moreover, there is light loss as such and hence a relatively dimmer viewfinder image is resulted.

Even worse, with the accommodation of this additional sensor and its associated optics, making a brighter, larger (higher magnified) projected viewfinder image with a higher percentage of actual image coverage has become more difficult. Particularly, 100% coverage is nearly impossible for such a design unless additional full scale half-mirror or split-prism is included to split the lights of finder image into two paths, one to the eyepiece and another to the LV sensor. Even putting aside the complexity of the required optic design, the whole viewfinder will be made rather large and heavy. And the Physics still is, the optical finder image will still be *dimmer*.

Another worse evil few people will notice is that at low light, this LV design simply won’t work well. The displayed LV image will become noisy owing to large amplification required for such only tiny amount of light as received by that LV sensor.

Oh well, when next time DPR and some other reviewers say loudly for the “Seamless Live View Operation” they like to emphasize from time to time, I think it would be better for them to tell more about the above mentioned two killing shortcomings!

3. Phase Matching AF Detection System

Basically, there is a set of AF measuring module with the required optics and electronics are placed under the mirror house, see this.

The Phase Matching Detection method is mature and should be fast and accurate by itself (as the AF systems are all designed based on). However, under LV by the Imager, there are additional overheads of mirror down and up in which time is added for the whole AF operation.

4. Contrast Detection AF (Software Algorithm)

It is just a pure software thing to detect the in-focus point just like what nearly all the P&S DCs do. The implementation is relatively slow for DSLRs, in general. For example, it has been verified uncountably by different reviewers and users that even latest Canon DSLRs in this mode could require 3 to 5 seconds to focus! My impression is that latest Olympus DSLRs like 420 and 520 are faster, though. For that speed of the Canons, I think it is a not yet mature technology and there should exist some limitations. I hope that things will be improved later when more of the existing technical difficulties are tackled.

The Implementions

Well, so there are two LV methods plus two AF methods under the LV mode – a total of four combinations:

1. LV with Imager; AF with Phase Matching
2. LV with Imager; AF with Contrast Detection (by Imager)
3. LV with Separate Sensor; AF with Phase Matching (and of course!)
4. LV with Separate Sensor; AF with Contrast Detection (by Imager? - Oh, it's NOT possible)

But in reality, the fourth combination is not possible as the Contrast Detection AF by Imager must happen at the same time with LV with Imager. In short, the LV with Separate Sensor in Finder and LV with Imager simply cannot be co-exist unless the main mirror is a split prism that split lights into the Finder and the Imager *at the same time*.

One may also ask why not to use the External LV Sensor for the Contrast Detection? There are two reasons: 1. It is not needed as the Phase Detection AF is always here; 2. The gathered light may not be adequate for better image quality for precision contrast AF detection.

1. LV with Imager; AF with Phase Matching

The operating procedures are as follows:-

(i) Mirror Up;

(ii) Enter LV mode by Imager;

(iii) Mirror Down for AF (the norm is a dedicated button other than the shutter release button is to be pressed (all the way down) to initiate action);

(iv) After AF is achieved, the Imager is Reset/Discharged (the Shutter is Closed so that no light is allowed to fall onto the sensor so that it can be discharged fully);

(v) After the Reset, the final image can be recorded by the Imager.

An example of this type of LV mode and AF operation is the Olympus E-410/510, just see the official instructions below:-
http://www.olympusamerica.com/cpg_section/images/support_images/How_to_Use_Live_View_E410_E510.pdf

Pentax K20D also uses this LV and AF method, however the AF interface/indication and LV functionality are both poorly implemented.

2. LV with Imager; AF with Contrast Detection (by Imager)

Many latest DSLRs offer this mode as an option. With pure software based algorithm, there are actually more to be played with, e.g., face detection. Canon 40D/450D/5D MkII, Olympus E-520, Panasonic L-10 and Nikon D300/D90, etc. are all having such a mode.

The Procedures are as follows:-

(i) Mirror Up;

(ii) Enter LV mode by Imager;

(iii) No need for Mirror Down to do the AF (usually a dedicated button other than the shutter release button is pressed to initiate action – the method of AF whether by Phase Detection or by Contrast Detection is to be set in a custom function option or by different buttons as assigned, depending on the design);

(iv) After AF is achieved, the Mirror is Lowered (which could be skipped, if mechanically allowed?) and Shutter is Closed so that the Imager can be Reset/Discharged (the Shutter must be Closed so that no light is allowed to fall onto the sensor for it to discharge);

(v) After the Reset, the final image can be recorded by the Imager.

But, as said, the problem with the Contrast Detection AF is mainly about its (slow) speed, the shutter is still required to be closed before taking the actual picture so that the Imager can be reset, which just introduce more time delay for resetting such a large Imager.

3. LV with Separate Sensor; AF with Phase Matching

Procedures:

(i) Enter LV mode by activating the LV Sensor in the Finder;

(ii) Doing AF as usual – half pressed shutter release button;

(iii) Take the picture!

Well, as it can be seen, that’s the “Seamless Operation" which DPR reviewers (and quite some others) like. But they just forgot to mention about the real weaknesses and limitations of this LV mode, particularly, the dark blindness and actually it is NOT WYSIWYG, no matter on actual image coverage, DoF, exposure and so on. What the user could see is JUST a very close *simulation*. Nonetheless, this LV still helps much in the shooting flexibility and for composition, undoubtedly.

Example (for Sony A300/350):-
http://www.photoclubalpha.com/2008/01/31/how-the-live-view-a300-and-a350-will-work/

Actually, this is just the same original Olympus E-330 design (Mode A LV). Just see above!

7 Comments:

Anonymous said...

And what does this have to do with Pentax? You failed to say a single bad thing about the Pentax in this article.

RiceHigh said...

Do you mean that just because nearly all Pentax DSLRs, even include the just announced K-m/K2000 do not have the Live View feature, then Pentaxians should avoid mentioning Live View??

The only Pentax DSLR so far which has Live View is the K20D, but its Live View is lamely implemented. (You failed to see that I've already mentioned this?)

Anonymous said...

Well it seems that the people who choose to buy a Pentax belonging to these "nearly all Pentax DSLR's" judge that they don't need the Live View to take good pictures. Obviously they are looking for other specifications that suit them better (built-in Shake reduction for example, cheap old lenses, etc). And if they really need the Live view they choose another brand (or buy a K20d). It's as simple as that and just a matter of choice. And how do I know that ? Well I'm part of these people who chose to buy a Pentax. So your description of the live view and it's functioning is just pointless and it is natural to wonder what is your goal.

Anonymous said...

Brilliant article!
BTW what is your point of view as far as D700 (vs 5DMKII) is concerned?
thnx!

RiceHigh said...

I'm glad that you like my article!

Regarding D700 Vs 5D MkII, what I can say is each has its own benefits. Just say:-

D700 Advantages over 5D MkII: Built-in flash, weather sealed, stronger AF system, flash system seems to be more accurate, more advanced and accurate (colour) metering system and so on.

5D MkII benefits: Much higher pixel count (yet very low noise, even at high ISO speeds), innovative Full HD H.264 video with uncompressed PCM sound recording, slightly smaller and lighter body (but it lacks built-in flash and weather sealing), EOS is a more accurate exposure system, I think (not about metering).

Its a very tough choice and decision to be torn between the two! :-) But still, if I had to choose one right now, I think I would still choose the D700 as its advantages are in general more useful for taking still pictures, which is what a DSLR is basically for. The higher pixel count is nice but we have to scarify!

ilya said...

I find the third mode (LV using separate sensor) weak.
And here's the main reason. It is the fact that the manufacturers struggle with back/front focus variation on body/lens. Additionally, even small deviation of mirror angle from 45 degrees can give focusing error (and let's remember that AF SLR's actually have TWO mirrors, the smaller one behind the main one). And in this situation adding yet ANOTHER sensor with its OWN set of alignment problems will only make matters worse.
What is so compelling in mirrorless approach is that there is no (or much less) dependencies on alignment of internals.

RiceHigh said...

Yes and No. Yes, LV using another sensor requires further alignment and the preview results are not precise and exact. No, the AF will not be affected as it just uses the already-here AF system under the mirror box.

Post a Comment

Related Posts

 
Creative Commons License
RiceHigh's Pentax Blog by RiceHigh is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.