Google Colab Using GPU with Tensorflow version 1.0.0

colab_gpu.ipynb

I just tried to train the same Dateset which was in the course being used and it did well. when it comes to my problem for my own chatbot I prepared at least 60 Questions and answers dateset and applied to Data preprocessing. But It's not saving These models when trained. That's my problem sir. Any help?

Hi...i did follow all the instructions that are mentioned in the course and i started training using gpu. i have trained for a 100 epochs using different learning rates, but minimum weights are being recorded at 10 epochs only, so weights are not getting updated. so, can you share the number of epochs it took for you for the error to converge and can i find the already trained weights of the course online

Hi, almost 3 years passed and I don't remember what I used learning rate or epoch number.

Thankyou for the reply. Can you please suggest where might the problem be. it does not appear like the error will converge anytime soon. i have checked with different learning rates. this graph is for learning rate 0.001. if i increase the learning rate the gradient is exploding. i tried decreasing but still the error is not converging. Should i just keep the training for a large number of epochs like 500 and wait patiently

s.

Yeah. Thank you for the feedback. That time i was working Final project. Now I am doing masters of AI. :)
…
On Wed, 10 Nov 2021, 23:04 Onur Yartaşı, @.> wrote: @.* commented on this gist. ------------------------------ I just tried to train the same Dateset which was in the course being used and it did well. when it comes to my problem for my own chatbot I prepared at least 60 Questions and answers dateset and applied to Data preprocessing. But It's not saving These models when trained. That's my problem sir. Any help? [image: pk qaas] https://user-images.githubusercontent.com/65222100/81706608-ccbac500-9478-11ea-9b0a-e8f84d1fdf71.PNG Hi...i did follow all the instructions that are mentioned in the course and i started training using gpu. i have trained for a 100 epochs using different learning rates, but minimum weights are being recorded at 10 epochs only, so weights are not getting updated. so, can you share the number of epochs it took for you for the error to converge and can i find the already trained weights of the course online Hi, almost 3 years passed and I don't remember what I used learning rate or epoch number. — You are receiving this because you commented. Reply to this email directly, view it on GitHub https://gist.github.com/7b861ff3cff77bcf68846db3bec0b2a6#gistcomment-3958102, or unsubscribe https://github.com/notifications/unsubscribe-auth/APRTLVCDT24SYLMNU255PQTULKUKLANCNFSM4I3H65SA .

I am very happy, I wish you success.

I just tried to train the same Dateset which was in the course being used and it did well. when it comes to my problem for my own chatbot I prepared at least 60 Questions and answers dateset and applied to Data preprocessing. But It's not saving These models when trained. That's my problem sir. Any help?

Hi...i did follow all the instructions that are mentioned in the course and i started training using gpu. i have trained for a 100 epochs using different learning rates, but minimum weights are being recorded at 10 epochs only, so weights are not getting updated. so, can you share the number of epochs it took for you for the error to converge and can i find the already trained weights of the course online

Hi, almost 3 years passed and I don't remember what I used learning rate or epoch number.

Thankyou for the reply. Can you please suggest where might the problem be. it does not appear like the error will converge anytime soon. i have checked with different learning rates. this graph is for learning rate 0.001. if i increase the learning rate the gradient is exploding. i tried decreasing but still the error is not converging. Should i just keep the training for a large number of epochs like 500 and wait patiently s.

Sorry, I'm not working with machine learning anymore. Whatever I say will be wrong.

Thankyou for the reply anyhow

I just tried to train the same Dateset which was in the course being used and it did well. when it comes to my problem for my own chatbot I prepared at least 60 Questions and answers dateset and applied to Data preprocessing. But It's not saving These models when trained. That's my problem sir. Any help?

Hi...i did follow all the instructions that are mentioned in the course and i started training using gpu. i have trained for a 100 epochs using different learning rates, but minimum weights are being recorded at 10 epochs only, so weights are not getting updated. so, can you share the number of epochs it took for you for the error to converge and can i find the already trained weights of the course online

Hi, almost 3 years passed and I don't remember what I used learning rate or epoch number.

Thankyou for the reply. Can you please suggest where might the problem be. it does not appear like the error will converge anytime soon. i have checked with different learning rates. this graph is for learning rate 0.001. if i increase the learning rate the gradient is exploding. i tried decreasing but still the error is not converging. Should i just keep the training for a large number of epochs like 500 and wait patiently s.

Sorry, I'm not working with machine learning anymore. Whatever I say will be wrong.

Thankyou for the reply anyhow

Yeah. Thank you for the feedback. That time i was working Final project. Now I am doing masters of AI. :)
…
On Wed, 10 Nov 2021, 23:04 Onur Yartaşı, @.> wrote: @.* commented on this gist. ------------------------------ I just tried to train the same Dateset which was in the course being used and it did well. when it comes to my problem for my own chatbot I prepared at least 60 Questions and answers dateset and applied to Data preprocessing. But It's not saving These models when trained. That's my problem sir. Any help? [image: pk qaas] https://user-images.githubusercontent.com/65222100/81706608-ccbac500-9478-11ea-9b0a-e8f84d1fdf71.PNG Hi...i did follow all the instructions that are mentioned in the course and i started training using gpu. i have trained for a 100 epochs using different learning rates, but minimum weights are being recorded at 10 epochs only, so weights are not getting updated. so, can you share the number of epochs it took for you for the error to converge and can i find the already trained weights of the course online Hi, almost 3 years passed and I don't remember what I used learning rate or epoch number. — You are receiving this because you commented. Reply to this email directly, view it on GitHub https://gist.github.com/7b861ff3cff77bcf68846db3bec0b2a6#gistcomment-3958102, or unsubscribe https://github.com/notifications/unsubscribe-auth/APRTLVCDT24SYLMNU255PQTULKUKLANCNFSM4I3H65SA .

can you please help me out with my problem if you can. This is now my final year project

Hi there, Does it still work? I am getting an error that colab doesnt support tensorflow 1.0 anymore despite downgrading it to cuda 8.0

I could not make it work in google colab. I got the same error as you. I manually trained it on my local machine

@adnvenkatesh can you tell me were the responses any good and also that i have an xps 15 9570 so it has thermal limitations, can you send me your ckpt files to just test it?

As i have mentioned in the above discussion the error did not converge at all. The responses were very bad..just repitions of random strings.I have read in various sources about what might be the problem. I saw in some sources that adams optimizer has convergence problems. So i have implemented gradient descent optimizer and made some changes and got this to work

Can you kindly share your code ? I just need to understand the issues. Anyway, million thanks. Means a lot tbh for the help.

On the github somewhere if i remember correctly there are some very good implementations of gradient descent optimizer in this context in addition with the bidirectional encoder layers. Try using them for understanding. They are far more clear. My code was too messy for you to understand it.😅

Hey all,
Has anyone, in the recent period according to the given instructions, managed to run training on Colab of this model https://www.udemy.com/course/chatbot/ ?

Hi there @Sudar88, Unfortunately I tried alot but could not make it work out.

@MohammadHarisZia thanks for the answer. After many attempts I was not able to run training this model according to the given instructions.
If anyone has found a solution, I hope they will respond.