Google Drive and Bandwidth Limiting

As many of you will know, in the UK at least we have an issue with broadband in that it our upload speed is no-where near as fast as our download speed.  In my case, not untypically I can download (i.e. play videos, grab music,  files and web pages) at something like 6Mbps. However the less obvious UPLOAD speed is around 600Kbps (i.e. 10 times less). This is often disregarded and yet it is very important.  Some folk have as low as 300Kbps and this is very limiting – especially if you want to run something like Skype.

Where web pages are mainly about downloading (i.e. grabbing content) Skype is mainly about uploading – i.e. you are SENDING (uploading) your voice and video to the other party.  As uploading is the slower of the two, this then becomes the limiting factor for quality and reliability for Skype and other forms of conferencing software.

If your connection was doing nothing else, this would likely not be an issue – but even if you only have ONE PC on the network connection (and many homes and offices have several) you might still have issues thanks to OTHER processes/programs using up your limited upload capability.

Examples might be Google Drive, Dropbox, Box and other backup/sync solutions.  In the background these programs check for changes in files (perhaps a WORD document you may be editing) – and if there is a change this triggers an upload to the cloud. It happens automatically and in the background.

Thankfully the people at Dropbox put a LIMIT as to how much of your bandwidth the program can use – hence allowing it to work while you’re Skyping without bringing Skype to a grinding halt.

The people at Google are no-where near as thoughtful despite having (arguably) a better product and yet despite many discussions and gripes in Google forums – right now there is nothing to stop Google Drive eating up all of your available bandwidth. Similarly programs like LiveDrive may do the same though in this case you can, if you know what to do, limit the upload bandwidth.

But the real problem is actually knowing if this is happening. Let’s say you’re right in the middle of a Skype conversation and the quality degrades – is this your broadband connection or did you just update/overwrite something that’s now being backed up – what about the kids in the next room…how would you know if something else is using up your bandwidth – and if you DID know what would you do about it?

To the (possible) rescue comes NetBalancer. This is not free – though a limited version IS – go get the free download and see for yourself (I’m assuming you are on a PC, not a MAC – and I’m using Windows 7 64-bit – which works just fine).

image

The program once installed shows you (live) which processes are using what bandwidth – both for upload and download (*see up rate and down rate above and take note if the B in KB is upper-case that’s kilo-BYTES as against kilo-bits – roughly a kiloByte is 10 kiloBITS).  Note in the example here, I simply right-clicked GOOGLEDRIVESYNC and set an upload limit of 20KB/s i.e. that process is not allowed to upload at a speed of more than 200 kilobits a second no matter what… Google Drive left to it’s own devices would consume ALL of my upload bandwidth.

This program in the unregistered form will let you control up to any 3 processes. If you choose to pay them something like £20 ($29.95) you can control as many as you want. In my case, this will do just fine. In the example GOOGLEDRIVESYNC is the ONLY process I’ve limited. In addition (right click) I’m giving SKYPE HIGH upload and download priority!

Something I did notice- occasionally for no obvious reason – OUTLOOK does significant uploads in the background….. like 300Kbps significant – just briefly but enough to mess up a conversation.

I hope this is useful to you – if nothing else you now know where to look when having problems with upload bandwidth. For this to be effective you’d need this on any and all machines connected to your broadband as you never know what might be happening in the kid’s room when you’re having an important Skype conversation!

Advertisements

Unreliable Routers and WIFI access Points

Over the years I’ve dealt with unreliable WIFI access points and less frequently ADSL routers… and I’ve adopted a simple solution.

There seem to be many WIFI access points out there that are unreliable – that is they works for weeks on end and then at random stop working. It might be months, it might be days.

I’ve recently been piecing this together and one thought is resetting. No matter where you are but more likely in rural areas, you get mains spikes, dips or downright failures. Mains failures don’t usually cause a problem as anything over a second or two gives the reset circuitry in modern equipment time to discharge ready to run again – but quick spikes or dips, i.e. glitches, can leave microprocessors in a mess.

This is almost always down to rubbish reset circuits as I found out many years ago when designing PIC-based products full time. It is possible there’s a generation of designers still who aren’t aware of this and while some processors will have improved, others which CLAIM to have internal reset may well not have this down to a perfect art.

This certainly WOULD explain why some electronic kit which is left on 24-7 seems to fail on the odd occasion.

How many times have you heard someone say “I just turned it off and on again and it was fine”.  See my point?

Ok the simple solution is a timer – not the DIRT cheap kind with the rotary dial that work in 15 minute intervals and are HOPELESS as they lose time when the power is turned off… no, the slightly more expensive ones with an LCD display that KEEP the time.

Set them to reset the gadget at a time you won’t be worried about – say, on at 4am – and off at 3.58am… so they are on all day and turn off for 2 minutes near 4am. Of course if you work then you might want to pick a different time.

I’ve used this plan on several occasions and while not ideal, it’s a cheap, inexpensive and simple way to ensure your 24-7 kit remains working for 24-7, 365 days a year.   It’s a lot cheaper than a new router!

My New Home Network

I’ve been using the same network I put together from cast-offs over 10 years ago when we moved into the village and we figured it was about time to bring it into the 21st century.

Armed with a budget of £300 I went off onto the web in search of new kit – and I’m very pleased with the end product… The system includes Gigabit wired networking, 80211n multi-point wireless and load balancing/fall-over protection in case my primary service provision fails and to share out the load a little when the grandkids are over hogging bandwidth. I’ll explain this….

Vigor 2800vgBut first, the starting point… when we moved over here into the countryside 11 years ago I was on a budget, having spent a bomb kitting out my home office, I simply bought bulk networking cable, a bunch of connectors and I was very lucky to get some second hand ADSL router kit from friends. One of those routers is the Draytek Vigor 2800vg which of course is too old to handle modern high speed 802.11n wireless but which has MORE than done it’s tour of duty over the years and is still an excellent and supported router.

I’ve had access to all manner of ADSL modems and most of them by comparison to the Drayteks seem “amateur”.  I ended up with 3 of these and a Netgear unit giving 4 access points around the house – I also had Orange Wireless but that was so bad I turned it off. The Drayteks have all SORTS of useful tools that other kit simply doesn’t have – like decent bandwidth monitoring facilities, VPN, interchangeable aerials (I had WAY oversize aerials on my main unit to get more range).

Why so many routers/access points? Well, our house is a cottage and it’s built out of lots of VERY thick stone – WIFI just does not go through this stuff so you might have a great signal in the living room – walk around the corner to the kitchen and it’s gone. Also as we’re on one floor the distance from the kitchen to my office is quite large.  So one Draytek router acted as the ADSL router and access point (wired and wireless), the others as simply switches/WIFI access points. I also had a dedicated 16-port switch as I have lots of kit to plug into when I’m doing a bit of R&D. The two main machines and my NAS drive (network addressable storage – i.e. a black box with 2 disks in it) are all connected together by wire as WIFI is too slow for some operations – like moving massive files back and forth.

We have Internet access via the organisation I work with – and we also have Orange Broadband. Why the latter?

Orange rubbish access pointWell, I would not use Orange by choice but as we had a house phone line and Maureen has an Orange phone, they gave us broadband for a fiver a month – can’t really say no to that especially as it gives her free calls to Orange mobiles (the kids). Both broadband setups are limited by the BT cables here in the village and give around 6.5Mb/s download and around 500Kb/s upload. The Orange router is that big grey thing on the left and it’s useless, not reliable at all but I recently found that by sticking a timer on it so it resets overnight – it becomes reliable. Not much use however without some kind of automatic fall-over if it’s in use at the time (backups etc). We were going to upgrade this until I saw the reviews of it’s replacement on Amazon – voice after voice slagging off Orange for supplying the new unit – so – stick with the devil you know.

I’d been using a software switch on our computers to select between the two networks (main network and Orange backup) to try to do some kind of load balancing -  but of course that doesn’t work on mobiles which don’t support the software etc. and it’s manual and  “fiddly” so I included provider switching in my goals for the upgrade:

  • Faster wireless
  • Faster wired connection
  • Better coverage
  • Some kind of automatic switching/backup/fall-over

We have Apple TV and my videos and music etc. are stored on the NAS unit  so speed of connectivity is important – a request from the TV has to go off to Maureen’s computer – which gets the video from the NAS box and pipes it back to her computer and on to the Apple TV… it doesn’t take many bottlenecks to mess that up.

Well, I ordered the replacement gear and the first stuff that turned up was the cable (of interest I used CABLING4LESS – they seem pretty good and delivery was quick) – I chose ready-made lengths of CAT5-e (why not CAT6? From what I can read it’s for perfectionists and the price difference is high – I also had some decent cables which were gigabit-certified and wanted to use those).

Ok, back up a second – what’s the difference between the cables? If you look at your average network lead, there are 8 connections at each end. Cat-5 only uses 4 of them – whereas Gigabit networks need all 8.  So to have a Gigabit network your modem, switches and cabling all need to be updated to CAT5-e or better. But the cable is cheap -  I think I spent £30 in all.

I bought a range of colours of Cat5-e cable and started checking to see what needed replacing. The first shocker came when looking on the roof at some of the original cables put in place a decade ago – totally SHOT. I’ve never seen cable disintegrate so quickly on touch! Amazing what several years of even British sunlight can do.

So it quickly became a gutting operation – all but one grey lead (which miraculously is in perfect condition 11 years on AND is certified for Gigabit operation – as it spans the building I was quite relieved not to have to throw that one away).

Draytek Vigor 2830nNext stop the main ADSL router. I did my homework and I’m fairly confident I picked the best of the lot – the new Draytek 2830n. This really is a winner -  with dual inputs (3 if you include the ability to use a 3G dongle as a backup -  but we’ve no 3g in the village so that’s redundant), 4 Gigabit ports, multiple LANS, multiple VPNs… load balancing.. name it and it’s got it – well under £200 from Amazon. Took around half an hour to get that running with the existing kit – which includes a 16-output switch in my office for the various gadgets.

First things first – the 802.11n higher speed WIFI claims better speed and better range and I noticed a marginal improvement in range almost tmpEA80immediately. That’s at ONE end of the building. I then fitted a TP-LINK TL-SG1016D 16-port Gigabit switch to replace the old switch to give me some more connections – one of which attachés to the lead which goes right across the building to TP-Link 5 port unmanaged switchanother, smaller new unit, the TL-SG1005D 5-port Gigabit switch – which then feeds Maureen’s computer, the Apple TV and a new TP-Link 150Mbps Wireless N Access point at the far end.Tp-Link 802.11n WIFI access point The large switch indicates what speed the connection is running (10/100 or gigabit) with green indicators which is great.

Finally I had to wire the Orange ADSL unit all the way back to the Draytek second input and make sure the Draytek was aware of the incoming Orange network. Interestingly I had a problem in that I wanted to keep the same DNS (domain name lookup) – and the only one I could find at first was OPENDNS -  but they charge if you have more than one incoming IP address – I resolved the problem eventually by forcing the network to use GOOGLE’s DNS servers (8.8.8.8 and 8.8.4.4) and up to now they are working a treat.

For Wireless I gave both units the same name – ensuring they were using completely different wireless frequencies which are ALSO distanced from the frequencies used by neighbours.

The result  – even the iPad now works seamlessly anywhere in or around the building. The overall range is WAY better – but now needing only 2 wireless units and not 5.

Apple TV works smoothly – and having set up the Draytek to work from the main ADSL line, falling over to Orange (tested by simply pulling the broadband line out – operation continues more or less seamlessly, the only change being the external address changes of course) it’s all working a treat, no failures, drop-outs etc. – and all the kit is green – keeping power usage to optimum levels (this if often overlooked – the cost of running this stuff mounts up as it’s on 24-7).

I’m currently running scheduled backups to the NAS using GOODSYNC – and cloud backups using bandwidth-restricted LIVEDRIVE (that’s a long story) with unlimited backup, consuming around 100Kb/s of my 500Kb/s upload bandwidth to keep 2 computers constantly backed up in the cloud – but because of the dual-WAN setup I’m managing to split that – one machine backs up to my main ADSL, the other backs up to the Orange ADSL – all works a treat…  and hence leaving plenty of upload bandwidth for Skype on either (though one could always make use of more precious upload bandwidth). More detail as time permits – if you Google these products – all I can say is they work for me…. older kit will be on Ebay presently…