After spending hours trying to identify the correct driver version and the way to install Nvidia drivers, CUDA and cuDNN I have curated the steps here.
You can find the required CUDA and cuDNN version for tensorflow-gpu here: https://www.tensorflow.org/install/source
If you'd like a clean install, please uninstall the previous nvidia drivers and cuda version:
For apt-get driver and cuda install: