Help - Search - Members - Calendar
Full Version: Galbraith is finally done testing Canon's AF
Luminous Landscape Forum > Equipment & Techniques > Digital Cameras, Backs and Shooting Techniques
ericisaac
wow, couldn't they have just said yes, no or maybe?
macgyver
QUOTE (ericisaac @ Aug 1 2008, 10:08 PM)
wow, couldn't they have just said yes, no or maybe?
*


The last paragraph of the last page:
QUOTE (RG)
Canon has put considerable effort into correcting and improving EOS-1D Mark III autofocus in the 14 months since the cameras was introduced, but they have not yet made it, or its high-resolution counterpart the EOS-1Ds Mark III, deliver reliable autofocus of subjects in motion.
Mort54
Regardless of the brand loyalties we all have to some extent, I think we can all sit back and admire what Rob has done here. He deserves a grateful round of applause, in my opinion. He clearly loves the files he gets from the 1DIII and 1DsIII (and deservedly so), tho he clearly is still disappointed with some aspects of the AF in these bodies. I think the 1DIII and 1DsIII owners have been well served by Rob and have better cameras as a result of his efforts.
francois
QUOTE (Mort54 @ Aug 2 2008, 06:22 AM)
Regardless of the brand loyalties we all have to some extent, I think we can all sit back and admire what Rob has done here. He deserves a grateful round of applause, in my opinion. He clearly loves the files he gets from the 1DIII and 1DsIII (and deservedly so), tho he clearly is still disappointed with some aspects of the AF in these bodies. I think the 1DIII and 1DsIII owners have been well served by Rob and have better cameras as a result of his efforts.
*

I agree, Rob has put an extraordinary amount of work to dissect the Mk 3 autofocus system issues. I'm curious to see Canon's take on his findings.
EricM
Rob's results make me glad that most of my photography is of things that don't usually do much moving while my camera is aimed at them (mountains, trees, ets.) smile.gif
Khun_K
QUOTE (ron203 @ Aug 2 2008, 10:43 AM)

I did not use the camera tested by them but I found my 1Ds MK3 to be perfectly OK.
francois
QUOTE (Khun_K @ Aug 3 2008, 05:02 AM)
I did not use the camera tested by them but I found my 1Ds MK3 to be perfectly OK.
*

Me too, but I don't shoot much fast action with a 1Ds Mk3. So far, I've been very satisfied with its autofocus performance.
michael
It's important to note that only photographers who are shooting subjects in rapid motion at larger apertures who are going to encounter focus issues with the new Canon One series cameras. The other 95% will likely never see it.

But, having said that, it's a big black eye for Canon.

Michael
slobodan56
QUOTE (michael @ Aug 3 2008, 05:42 AM)
It's important to note that only photographers who are shooting subjects in rapid motion at larger apertures who are going to encounter focus issues with the new Canon One series cameras. The other 95% will likely never see it.

But, having said that, it's a big black eye for Canon.

Michael
*

Michael, not that I disagree with you... everything you said above is correct... just wanted to add my angle:

Just because a Ferrari can take you to the nearest supermarket to buy groceries, does not mean people buy Ferraris based on that ability. I would also argue that 95% of Ferraris will never be fully driven the way they are intended to be. So, if something would be inherently wrong with Ferraris, but would only show up at higher speeds, 95% of owners would 'likely never see it'. However, if it would ever turn out that Ferraris could not actually deliver on their basic promise (i..e, superior performance under conditions most owners would never take it to), most people would not be buying it and saying "Oh, well... at least it can take me to the supermarket".

Back to cameras: using your numbers, it is plausible that 95% of owners of 1D buy it not because they need it for 'subjects in rapid motion at larger apertures', but because precisely that use is what is supposed to be the main selling point for that camera, its sheer ability to do it. Without it, it loses its main marketing appeal, and that is the 'big black eye for Canon', as you rightly said. Most high-end products generate their profit not from a few professionals they are designed for, but from mass sales to those impressed by the pro performance.
MarkDS
The most disturbing thing Rob Galbraith's article underscores is the existence of problems with corporate culture at Canon. I say this fully recognizing the huge technological contribution they have made to digital imaging, but in this particular instance and others, there is a demonstrable insufficiency of product testing and quality control before these expensive high-end products leave the factory, combined with delay admitting issues and in some cases less than satiasfactory performance servicing the consequences. That they had the nerve to cut their collaboration with Rob Galbraith is one example of behaviour which underscores what I am saying here. Readers may also remember the issues with the IPF 5000 printer.

One should also bear in mind that this company manufactures a range of medical diagnostic equipment (opthamology, radiological, etc.) on which patients' health may depend. One may wonder whether they do a better job of QC and error correction on that stuff.
budjames
I've been a Canon shooter since high school. My first SLR was the Canon FTb in 1972. I just purchased the Canon 1DsMkIII 2 months ago and I've had a 40D for about 6 months. They work fine, but I'm not shooting fast action sports.

It is still a bummer that there is no clear acknowledgement by Canon to address the issue if only to clear the air. Now that Nikon has a FF DSLR at 40% less than the 1DsMkIII, I think that they might start to gain market share at the expense of Canon.

I have too much invested in L-glass and accessories to consider a switch. I'm very happy with my images, but I still want Canon to fix the problems.

Like previous posters, I agree that Ron deserves major kudos for his testing and research efforts.

Cheers.
Bud James
MarkDS
Canon has acknowledged the focus issue. It took them a good while, but that said, they have been working on improvements to firmware and for the 1DMk3 the hardware. Rob thinks they haven't fully solved it yet, which means they have more work to do - a different story from saying they haven't acknowledged it. The additional - and serious - issue which Rob raises in his article is whether they will devote more attention to a full fix, or will they refocus their sight on the next models to the detriment of customers owning current models.
MarkDS
QUOTE (michael @ Aug 3 2008, 05:42 AM)
It's important to note that only photographers who are shooting subjects in rapid motion at larger apertures who are going to encounter focus issues with the new Canon One series cameras. The other 95% will likely never see it.

But, having said that, it's a big black eye for Canon.

Michael
*


Michael, unfortunately the issue isn't confined to subjects in rapid motion according to Galbraith, viz:

"Every word about the EOS-1D Mark III and firmware v1.1.3 applies equally to the EOS-1Ds Mark III with firmware v1.0.6 installed. It shares the same tendency to imagine or overestimate forward motion and the same difficulty holding focus on a stationary subject. "

"With either the EOS-1D Mark III and firmware v1.1.3 or the EOS-1Ds Mark III with firmware v1.0.6, AI Servo autofocus won't hold still on a static subject. "

"Just enough testing was done to reveal a few things. Whereas the older firmware can introduce a change in focus distance with each One Shot activation, even if the AF point is aimed at the same subject at the same distance each time, the newer firmware seems to give more repeatable and accurate focus results under the same conditions. But if the test is done slightly differently - setting the focus to some other distance, then focusing one time on the subject using One Shot, autofocus variability seems about the same as before: there's too much."

"To give yourself a reasonable chance with One Shot, it looks like you'll want to pump the autofocus two or three times with it pointed at the same area of the subject. Alternatively, switch the camera to AI Servo, configure it to autofocus only when the rear AF-ON button is pressed, then "lock" the focus by releasing AF-ON. Not only did AI Servo produce more consistent stationary subject autofocus than One Shot (albeit in limited testing), it also means you don't have to switch AF settings when the subject starts to move. Just press AF-ON.
I Servo autofocus won't hold still on a static subject. "

"Static focus stability - which was a real source of telephoto shooting troubles with the EOS-1Ds Mark III through the early months of 2008 here - is much improved, though some twitchiness remains."

"When these cameras are set to AI Servo, the newest firmware is loaded and the subject being photographed is stationary or moving slowly, the results are much better than before: autofocus is now acceptably stable and acceptably accurate. The cameras' tendency to shift the focus is still lurking inside, it's just mostly dormant."

These quotes would seem to indicate that the focus issue is more general, but the firmware up-grades help (less than 100%) with both cameras.

Where you say the other 95% will likely never see it - maybe so. The problem here is the real difficulty of sorting out cause and effect when there is also an anti-aliasing filter in the path softening the image regardless of how well focused it is. So what we really need to do when we pixel-peep raw files for focus is adjust for background anti-aliasing. This means we are looking at second-order differences of sharpness between a correct and a slightly incorrect focus. Perhaps not easy except under well-controlled conditions designed to parse this dual causality.

Cheers,

Mark

Edited 10:10 PM EDT to unscramble two quotes.
zlatko-b
I agree -- they did acknowledge the focus issue -- and numerous cameras were recalled for a sub-mirror fix -- and there was a firmware update that made improvements. This is not a company that has ignored the issue. If they've failed to address it fully, it's not for lack of trying.

Rob G. still uses the cameras for his day-to-day work (and he explains why). This is remarkable when you consider the demands that his sports work places on the AF system.

I've had pretty good success with the 1D3, but my subject matter is entirely different (not fast moving) and I almost always use One Shot.
Tim Gray
Yes, Canon acknowledged a problem. (note past tense) But I suspect their position is that it's been fixed. One of RG's important points is that the 1DMKII has better performing AF than the 1DMKIII (at least in certain circumstances). Canon has not acknowledged that, and probably never will.

At some point in the future, I hope RG will take an equally rigorous look at the 1DMKIV.
MarkDS
QUOTE (Tim Gray @ Aug 3 2008, 05:55 PM)
At some point in the future, I hope RG will take an equally rigorous look at the 1DMKIV.
*


If they let him, it's best done before the camera hits the market!
Kagetsu
Personally I was more interested in a point mentioned on the second page, and a little further on the third page of his latest update, in reference to the low light performance of the AF. This is a problem I've also noticed, and to me just seems very poor that either it's not been addressed or is insignificant to many people who use this camera (and the 1D III).

Personally I found my old 5D to focus significantly better in low light situations.
MarkDS
QUOTE (Kagetsu @ Aug 3 2008, 11:34 PM)
Personally I was more interested in a point mentioned on the second page, and a little further on the third page of his latest update, in reference to the low light performance of the AF. This is a problem I've also noticed, and to me just seems very poor that either it's not been addressed or is insignificant to many people who use this camera (and the 1D III).

Personally I found my old 5D to focus significantly better in low light situations.
*


Kagetsu,

I have to say there are aspects of Galbraith's article which leave me perplexed as thorough a job as he appears to have done, and it is this quandary which caused me to comment on Michael's contribution from yesterday - because when Michael tells us 95% of us won't see an issue with focusing, he's drawing on a wealth of experience. Yet based on what he said, unless I've misunderstood something, Galbraith seems to be seeing things that many other people don't see. To wit, I own a 1DsMk3 and I know three other people here in Toronto who own one also. All of us use this camera primarily in one shot mode and none of us are sports photographers. All of us have marveled at the quality of resolution this camera displays, but at the same time (and now just speaking for myself) these raw files do need judicious sharpening to fully reveal this quality - a factor which must relate to the A-A filter, which of course is there for good reason.

Now turning to your point about focusing in low light situations, this issue has come up before - in this Forum if I'm not mistaken. When things like this arise, the first thing I do is get worried and ask myself - O.M.G. does this mean I bought a lemon? The next thing I do is settle down and test it. So late at night when all was dark except for a low voltage ceiling light on the second floor landing of our house, I pointed the camera into a dark room and took a succession of shots with the door to that room incrementally closed further so less and less light could enter the room. That camera kept on focusing decisively until it was so dark in there I could hardly see what the camera was focusing on - at a distance of about ten feet lens to subject. So in the case of my sample of this camera, there is no low light focusing problem. But that doesn't mean there isn't a problem - you say you have one and I have no reason to doubt you. So from this limited sample of two, one may begin to infer that perhaps there isn't a GENERIC technical problem with low-light focusing, but another - and in a sense more elusive - problem of variable performance between samples of this camera, and that may boil down to a question of standards maintenance/quality control.

Cheers,

Mark
MarkDS
QUOTE (Tim Gray @ Aug 3 2008, 05:55 PM)
Yes, Canon acknowledged a problem.  (note past tense)  But I suspect their position is that it's been fixed.  One of RG's important points is that the 1DMKII has better performing AF than the 1DMKIII (at least in certain circumstances).  Canon has not acknowledged that, and probably never will.

At some point in the future, I hope RG will take an equally rigorous look at the 1DMKIV.
*


Tim,

I'm coming back to your post once again, because you've indirectly raised another issue which forcibly comes to mind in this context. You will recall that the 1DMk3 hit the market well before the 1DsMk3. You may also recall that customers observed the focus problem soon afterward and also well before the release of the 1DsMk3. I also recall seeing speculation that maybe the release of the 1DsMk3 was being held back till Canon verified that none of these focus problems would affect this model. Contrary to that speculation, we now we have Galbraith saying that the focusing problems discussed in relation to the 1DMk3 also apply to the 1DsMk3. If this were correct, it is really distressing to contemplate that the 1Ds3 was released knowing the likelihood of technical flaws, and tends to reinforce one's impression that perhaps Canon has some product testing and QC issues to deal with. Given the amount of money we invest in what is supposed to be the pinnacle of professional equipment, and eventhough I'm using mine I believe quite successfully, I find all of this really discomforting, because I'd like to believe that at this price point we wouldn't need to be concerned about either embedded technical defects or sample to sample variability of important performance characteristics.

Cheers,

Mark
Khun_K
I don't believe and don't think there is a perfect camera and I don't rely on a perfect camera to get work done. The accuracy we are talking about today is much higher than those from 10 years ago when we use magnifier on film and thought most of them were perfectly focused. The degree of out of focus is increased when sensor resolution becomes higher, as the depth of field continue to shrink when ten of million pixels continue to add to a sensor. I do believe most of the camera makers, Canon included, made improvement on their system and mechanism, they don't make it worse. But then I do not think there is enough reason to allow maker to make less than perfect cameras, they should all improve endlessly.
However, I also believe we should work with our camera like partners, learn to use them, learn how they behave and react/control their behavior, make the most out of it. When a camera can deliver 90-95% of its function will be good enough for me, not that I can accept less, but I can accept reality. Just like when my digital back cannot get good enough quality at the highest ISO setting, I can go to use 1Ds MK2/MK3 or some may go to Nikon. But this is just me.
MarkDS
QUOTE (Khun_K @ Aug 4 2008, 08:59 AM)
I don't believe and don't think there is a perfect camera and I don't rely on a perfect camera to get work done.  The accuracy we are talking about today is much higher than those from 10 years ago when we use magnifier on film and thought most of them were perfectly focused. The degree of out of focus is increased when sensor resolution becomes higher, as the depth of field continue to shrink when ten of million pixels continue to add to a sensor. I do believe most of the camera makers, Canon included, made improvement on their system and mechanism, they don't make it worse. But then I do not think there is enough reason to allow maker to make less than perfect cameras, they should all improve endlessly. 
However, I also believe we should work with our camera like partners, learn to use them, learn how they behave and react/control their behavior, make the most out of it.  When a camera can deliver 90-95% of its function will be good enough for me, not that I can accept less, but I can accept reality. Just like when my digital back cannot get good enough quality at the highest ISO setting, I can go to use 1Ds MK2/MK3 or some may go to Nikon. But this is just me.
*


Khun K,

I agree with you about the nature of "perfection" largely because we don't know what that is - in the abstract. So I have a more operational definition of "perfection": things that work in the manner they are advertised or purported to work. That makes the whole discussion more tangible.

As for the quality of focus in cameras of yester-year, let us take care. We don't need to go back to the combination of a Leica M-series cameras with their Summicron lenses from decades ago, but a comment from Rob Galbraith which Tim Gray noted in this thread - to the effect that focus problems existing in the 1DMk3 did not exist in the 1DMk2. Doesn't this kind of make you think that sometimes technology regresses rather than progresses (perhaps because in the course of redesign things that were better before got messed-up now, and no-one caught it before releasing the product)?

I don't know of any technical reason why a higher sensor resolution should compromise focus in any way. If anything a higher resolution sensor should better reflect good focusing. Likewise, as far as I know, there is no technical relationship between depth of field and sensor resolution.

On your final point about accepting reality - sure - at some point in the sequence of events one has little choice, and no camera is equally good at everything even if there is nothing wrong with it. But when it comes to dealing with technical defects, the issue here is more up-stream about altering the reality so that camera manufacturers deliver what they advertise, or don't advertise it, or if they make a mistake, which is only human, acknowledge it and fix it as a matter of the highest priority. I think we the customers deserve this kind of consideration, and one is sometimes left wondering to what extent we really get it.

Cheers,

Mark
EricM
It certainly seems that Canon has gotten a bit complacent recently. My hope, as one who is heavily invested in Canon glass, is that the new offerings from Nikon will frighten Canon into cleaning up their act a bit.
Khun_K
QUOTE (MarkDS @ Aug 4 2008, 09:53 PM)
Khun K,

I agree with you about the nature of "perfection" largely because we don't know what that is - in the abstract. So I have a more operational definition of "perfection": things that work in the manner they are advertised or purported to work. That makes the whole discussion more tangible.

As for the quality of focus in cameras of yester-year, let us take care. We don't need to go back to the combination of a Leica M-series cameras with their Summicron lenses from decades ago, but a comment from Rob Galbraith which Tim Gray noted in this thread - to the effect that focus problems existing in the 1DMk3 did not exist in the 1DMk2. Doesn't this kind of make you think that sometimes technology regresses rather than progresses (perhaps because in the course of redesign things that were better before got messed-up now, and no-one caught it before releasing the product)?

I don't know of any technical reason why a higher sensor resolution should compromise focus in any way. If anything a higher resolution sensor should better reflect good focusing. Likewise, as far as I know, there is no technical relationship between depth of field and sensor resolution.

On your final point about accepting reality - sure - at some point in the sequence of events one has little choice, and no camera is equally good at everything even if there is nothing wrong with it. But when it comes to dealing with technical defects, the issue here is more up-stream about altering the reality so that camera manufacturers deliver what they advertise, or don't advertise it, or if they make a mistake, which is only human, acknowledge it and fix it as a matter of the highest priority. I think we the customers deserve this kind of consideration, and one is sometimes left wondering to what extent we really get it. 

Cheers,

Mark
*

I agreed with you totally, just that I look at the camera a smaller part of photography, but, sure, any improvement from camera makers is welcome. Perhaps I don't use the focus tracking at the maximum firing rate often enough to tell the defects or I just got lucky to have a good sample.
Chris_Brown
QUOTE (EricM @ Aug 4 2008, 10:22 AM)
It certainly seems that Canon has gotten a bit complacent recently. My hope, as one who is heavily invested in Canon glass, is that the new offerings from Nikon will frighten Canon into cleaning up their act a bit.
*

If the replacement of the Firewire connection with USB is any indication, then Canon has lost site of making a perfect tool for working professionals. Only those whose income rests on the consistent quality of image will find faults like sloppy focus and crooked viewfinders. What market share is that? If that market share left and went to Nikon would it have an adverse effect on Canon? After all, the best selling digital camera of all time is the EOS Rebel. In addition, Canon has R&D in many areas. Could they be looking at other, more profitable industries?
Slough
I don't pretend to know anything about Canon gear - apart from second hand information - but there is a thread on this same issue in the Canon EOS forum on Photo Net. The overwhelming opinion is that there is no problem, apart from RG not being able to use the camera.

Whatever the truth of this matter, it is a gift to Nikon, as it has surely damaged Canon's reputation.
Plekto
So is this a problem with the optics or is it that the thing has too many focusing zones and choices for the software/AI to deal with? Or is it just shoddy quality control and some units are junk while others are fine(kind of like VW - heh)?
MarkDS
QUOTE (Slough @ Aug 4 2008, 12:30 PM)
I don't pretend to know anything about Canon gear - apart from second hand information - but there is a thread on this same issue in the Canon EOS forum on Photo Net. The overwhelming opinion is that there is no problem, apart from RG not being able to use the camera.

Whatever the truth of this matter, it is a gift to Nikon, as it has surely damaged Canon's reputation.
*


Slough,

I went to Photo.net and read each and every one of those posts. My interpretation of all that material is that a few of them took serious issue with RG's analysis. Others agreed with him and others were more agnostic one way or another.

Interesting also is Atkin's reference to Drew's published analysis which is really worth looking at. He compared the 1DMkIII (about which he's been writing for quite some time regarding the focus issue in particular) and the Nikon D3. He found both of them to have less than stellar performance, but the Canon was less flawed than the Nikon.

Reading that makes me wonder whether we're not simply dealing with a situation of over-reaching and hype - not on the part of web reviewers, but by the manufacturers themselves. Maybe they are trying to deliver more than they really can, raising false expectations. It gets more interesting as it goes!

The next thing is that over at Photo.net the moderator abruptly closed the thread after 25 posts, none of which were rude, blasphemous, libelous or anything or the sort. One wonders why that happened?

Cheers,

Mark
Ray
QUOTE (MarkDS @ Aug 5 2008, 02:58 PM)
He compared the 1DMkIII (about which he's been writing for quite some time regarding the focus issue in particular) and the Nikon D3. He found both of them to have less than stellar performance, but the Canon was less flawed than the Nikon.

Reading that makes me wonder whether we're not simply dealing with a situation of over-reaching and hype - not on the part of web reviewers, but by the manufacturers themselves. Maybe they are trying to deliver more than they really can, raising false expectations. It gets more interesting as it goes!
*


Mark,
I wondered about that. One usually complains about a camera's performance because it's not up to the standard that is possible and evident in other models or brands. There's an implication in all this brouhaha that perhaps the latest Nikons do a better autofocussing job. If this is not true, then I think you are probably right in your assessment that Canon has simply raised false expectations in its advertising hype.
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please click here.
Invision Power Board © 2001-2008 Invision Power Services, Inc.