Switch from Latest to Conversation

Switching back and forth between the "Latest" and "Conversation" view works fine when I go to a thread directly. (It starts as a conversation and I can set it to latest and back.) But when I click on the latest post of a subthread or the latest post of a single thread I get the "Latest" view (as expected) but can't switch to the "Conversation" view. When I click "Conversation" the only thing that happens is that I jump back to the first post in the latest section. (Chrome, Windows 7)

(Was this understandably phrased? I'm a bit tired.