Comments on: Help me help my browser to go back to completing missing URL endings even though my ISP is jerky

Question: Help me help my browser to go back to completing missing URL endings even though my ISP is jerky

Your Time Machine Sucks — Fri, 05 Jun 2009 07:39:57 -0800

My ISP's new "feature" of rerouting incomplete URLs to their own custom (awful) search page is hijacking my normal browser behavior of completing URLs with .com. Anything I can do to reassert normalcy?

My ISP is T-Online, which like a few other ISPs has started to hijack malformed URLs and send me to an awful "did you mean...?" page, which coincidentally happens to contain advertisements.

Until this started happening a week ago, if I typed "something" into my Safari 3.2.1 (OS X 10.5.x) location field, Safari would complete the URL as "something.com" and go there, but no longer (at least, I was under the impression that this was a Safari thing and not a DNS thing, since Internet Explorer always manifested the re-route-to-a-search-page behavior).

T-Online claims that it is possible to opt out from their new "Navigationshilfe" ("Navigation Help") program, but when I followed their instructions to opt out, nothing changed. Is there a technical solution for this? My router runs dd-wrt so if there is anything I can do there or on my local machine with DNS or hosts settings, that would be ideal.

T-Online's customer support is pretty dumb, so I will consider calling them if there is no workaround, but it is improbable that they will a) know what I'm talking about, b) know if it is possible to turn it off, c) take the correct steps to turn it off, d) not somehow find a way to increase the cost of my plan in the process, so that is definitely a last resort.

Thanks for any advice!

By: SirStan

SirStan — Fri, 05 Jun 2009 07:48:42 -0800

Change your DNS servers in your router. Start with 4.2.2.2 -- if that solves the problem, find a closer DNS server (OpenDNS?) that works well for you.

The forwarding usually works via DNS.. so disabling T-Online's DNS servers (or atleast not using them) will fix the issue.

Since your machine is told about DNS through the router; changing them in the router will fix it for all.

By: majick

majick — Fri, 05 Jun 2009 07:48:58 -0800

" Is there a technical solution for this?"

Yes. Don't use your ISP's DNS servers. Pick something else.

If your router is configured for dnsmasq and that's what the attached clients use, you'll want to change the DNS server values it uses. Otherwise you'll want to change the configuration on the clients directly or change the value that is handed out by your DHCP server.

By: flabdablet

flabdablet — Fri, 05 Jun 2009 07:50:44 -0800

Your router is reponsible for telling your computer what DNS server(s) to use when the computer asks for stuff via DHCP. I don't know DD-WRT well enough to know whether it can run a proper DNS server inside itself; if it can, turn that on, tell it to hand out its own address as the DNS server via DHCP, and have it use 4.2.2.1 and 4.2.2.2 as its upstream forwarders instead of whatever crap your ISP is handing you. If the router can't be a DNS server, just have it hand 4.2.2.1 and 4.2.2.2 to its DHCP clients.

By: Your Time Machine Sucks

Your Time Machine Sucks — Fri, 05 Jun 2009 07:54:02 -0800

Also, I realize that the simplest workaround is to type the full URL, but I'm working against about a decade's worth of muscle memory here, so it would be great to find an actual fix.

By: FishBike

FishBike — Fri, 05 Jun 2009 07:54:21 -0800

When my ISP implemented the same ~~service~~ foolishness, I ended up installing a DNS server on my laptop, to provide my own DNS service from now on. In my case it was because it broke my VPN connectivity, which relies on DNS lookups for private host names failing, and thanks to their advertising engine, these were all successful instead.

Safari probably does a similar thing, e.g. tries to look up the exact name you typed first, and if that doesn't work, try appending .com, .net, and so on until it finds one that does. And now that your ISP makes every lookup "work", it can no longer detect that the first thing you typed isn't a valid name.

I'm sure there is a free DNS server you can install on OS X, and then you just modify your network settings to tell it to use 'localhost' or equivalent as the DNS server, instead of your ISP's DNS servers. I know little about OS X though, so I couldn't tell you how. But as long as your ISP hasn't actually tried to block DNS requests to servers other than their own, this should work.

By: Your Time Machine Sucks

Your Time Machine Sucks — Fri, 05 Jun 2009 07:55:05 -0800

Awesome, thanks for such fast and good answers, folks. Opening up the router config right now and will report back.

By: nathan_teske

nathan_teske — Fri, 05 Jun 2009 08:07:11 -0800

You should also notify your ISP of their anti-customer stupidity.

By: jmd82

jmd82 — Fri, 05 Jun 2009 08:17:53 -0800

No specific fix, but just chiming in that I'm with Charter, and they do the same thing. Even after I opt-out, they still manage to hijack and display the old IE "server not found" error when I get a bad URL. And I use OpenDNS on my dd-wrt router.

By: jaythebull

jaythebull — Fri, 05 Jun 2009 08:20:55 -0800

OpenDNS. OpenDNS. OpenDNS.

By: uaudio

uaudio — Fri, 05 Jun 2009 08:54:33 -0800

Non-technical, but something simple that I've used for years:

I assume you're typing something like "google" in the address box, then pressing enter and hoping for http://www.google.com/. In most modern browsers, Firefox and Safari included, if you type "google" and press Control + Enter, it will form the "http://www." and ".com" parts of the address, then send you to the correct address. On a Mac, I believe the command key does the same thing.

By: Your Time Machine Sucks

Your Time Machine Sucks — Fri, 05 Jun 2009 09:02:09 -0800

OpenDNS in the router config did the trick! Thank you all, much happier now.

Addendum for other folks prone to the same mistake I made: after changing the DNS server in the router, it may still be necessary to reboot the local machine or enter whatever the command is for a network reboot on your system in order to get the local machine to stop caching the old DNS server IP address and confusing the hell out of you.

By: odinsdream

odinsdream — Fri, 05 Jun 2009 09:07:06 -0800

OpenDNS. OpenDNS. OpenDNS.

OpenDNS does the same thing, though.

By: Your Time Machine Sucks

Your Time Machine Sucks — Fri, 05 Jun 2009 09:17:37 -0800

OpenDNS is fixing the issue mentioned in the question.

By: FishBike

FishBike — Fri, 05 Jun 2009 10:22:15 -0800

OpenDNS is great, we use it at work and love it. While it technically does sort of the same thing your ISP did to you (in that all DNS lookups now succeed, even ones that "shouldn't"), they try to be more helpful than just redirecting you to an advertising page in all cases. If their system can figure out where you were trying to go, then you'll still end up there. Otherwise you'll get an advertising-supported search page. If you set up an account, you can even exclude certain domains (which are supposed to fail) so that VPN stuff works correctly again.

So you're getting the same functionality (actually better -- OpenDNS seems to do a better job of correcting things than browsers do), just implemented in a different place. Folks who didn't suggest OpenDNS (well, me, anyway) may just have interpreted the part of the question that said "Anything I can do to reassert normalcy?" to mean "How do I make this browser feature work exactly like it used to?"