I haven't done any overview.html but I have been doing a lot of HTML controls for dialogs recently. The only way I can get the arrows to show up to scroll through in those is to structure it like this:
<html>
<body>
<h2><a name="Main"></a></h2>
<p>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</p>
</body>
</html>
Note that there is to text for the anchor tag "Main" (can be called anything) and there is no internal target marked with "#" later in the document. If I try any other sections or links I get variable results. If I do this I get the arrows to show up. Maybe it will work for overviews too!