Chrome Dino Game Automation with Python.

Motive 

        I saw a video on YouTube that made a python program to automate the chrome dino game at the end he shows a clip of the program playing the game. But there was a problem with the code I do not work when it's dark so I thought of turning the dark mode in the laptop

so that it stays dark all the time but that did not work after reaching a score of 700 it becomes day again so I have to think of an alternative see how I did it.

The Project 

1. First Import the necessary modules in your IDE

import pyautogui from PIL import Image, ImageGrab import time

• PyAutoGUI lets Python control the mouse and keyboard, and other GUI automation tasks.

                First, open your terminal and run pip 

                    learn more on Pyautogui

                    

• Pillow helps us to take screenshots

                Like Pyautogui we have to install it so run pip install Pillow

                    learn more on Pillow

    2.Play till you reach a cactus which is as tall as the dino

        Note:  If your screen is dark instead of the light background 

                1. Go to settings

                2. Then personalization 

                3. Colors

                4. Scroll down and check the 'light' box  

                5. Back to your browser and reload your page

    3. Go back to the idle and paste this code

if __name__ == "__main__": time.sleep(2) while True: image = ImageGrab.grab().convert('L') data = image.load() # Draw the rectangle for cactus for i in range(170, 320):#x axis for j in range(420, 500):#y axis data[i, j] = 0 image.show() break

    run the code and quickly go back to the browser after about 2 sec a screenshot will appear that has a black rectangle in front of the cactus, you have to mess with the x-axis and the y-axis of the rectangle to make it look somewhat like this:

now you have to make sure that the rectangle doesn't touch the ground and is as tall as the cactus. try again and again until you get something like that picture

The code will wait for two sec and then takes a screenshot and convert it into grayscale then store that image in a variable called image. Then makes a rectangle with the given values.

    4. After getting the right values, let's make a function to make the dino jump when it reaches the

 cactus:

def cactus(data): for k in range(170, 320):#x for l in range(420, 500):#y if data[k, l] < 100: hit("up") return

change the values of x and y to the values that you got, this function presses the up button when there is is a dark pixel(here < 100 is considered as black) in the rectangle we made

    5. Now edit the if __name__ == "__main__": part like this:

if __name__ == "__main__": time.sleep(2) hit('up') while True: image = ImageGrab.grab().convert('L') data = image.load() cactus(data) ''' # Draw the rectangle for cactus for i in range(170, 320):#x for j in range(420, 500):#y data[i, j] = 0 image.show() break '''

Now run the code and go back to the browser, you will see the dino jumping automatically when it reaches the cactus, if not try changing the rectangle values this might work, if the dino is jumping continuously check if the rectangle is touching the ground or the stone if so reducing the y-axis second value a little more and try again. Still, if it does not work comment down below and it will solve your problem.

Note: To stop the while loop go to the ide and press ctrl+c

6. The dino will run till it becomes dark or if a bird comes so now we will fix them:        

        for the bird make another rectangle:

So again edit the if __name__ == "__main__": part like this:

if __name__ == "__main__": time.sleep(2) #hit('up') while True: image = ImageGrab.grab().convert('L') data = image.load() cactus(data) # Draw the rectangle for cactus for i in range(170, 320):#x for j in range(420, 500):#y data[i, j] = 0 # Draw the rectangle for bird for i in range(170, 320):#x for j in range(400, 420):#y data[i, j] = 170 image.show() break

And you will get something like this,

        let the x-axis for the bird be as the x-axis of the cactus and the y-axis of about 20 pixels long

it may differ according to your screen.

7. Now edit the cactus function like this:

def cactus(data): for k in range(170, 320): for l in range(400, 420): if data[k, l] < 100: hit("down") return for k in range(170, 460):#x for l in range(420, 500):#y if data[k, l] < 100: hit("up") return

 

This also works as the cactus instead of jumping it crouches.

Try running this by commending out the draw rectangle like this:

if __name__ == "__main__": time.sleep(2) hit('up') while True: image = ImageGrab.grab().convert('L') data = image.load() cactus(data) ''' # Draw the rectangle for cactus for i in range(170, 320):#x for j in range(420, 500):#y data[i, j] = 0 # Draw the rectangle for bird for i in range(170, 320):#x for j in range(400, 420):#y data[i, j] = 170 image.show() break '''

Note: To stop the while loop go to the ide and press ctrl+c

8. Now this will also work till it becomes night so we need to find when it is day and when it is night.

For that, we create another rectangle in a corner and get its value.

again edit the if __name__ == "__main__": part like this:

 

if __name__ == "__main__": time.sleep(2) # hit('up') while True: image = ImageGrab.grab().convert('L') data = image.load() cactus(data) ''' # Draw the rectangle for cactus for i in range(170, 320):#x for j in range(420, 500):#y data[i, j] = 0 # Draw the rectangle for bird for i in range(170, 320):#x for j in range(400, 420):#y data[i, j] = 170 ''' # Draw the rectangle to find the pixel value for i in range(10, 15):#x for j in range(95, 100):#y data[i, j] = 170 image.show() break

you will get a small rectangle at the corner of the screen like this(you might have to change the x-axis and  y-axis to get it at a corner):

9. Now we need to find whether it's day or night by looking at the pixel value if  >200 we consider it as day and < 201 we consider it and night 

    Again try changing its value to take the program to perfection.

     Now change the  if __name__ == "__main__": part like this:

if __name__ == "__main__": time.sleep(2) hit('up') while True: image = ImageGrab.grab().convert('L') data = image.load() cactus(data) for i in range(10, 15):#x for j in range(95, 100):#y if data[i, j] < 201: Time = 'night' elif data[i, j] > 200: Time = 'day' ''' # Draw the rectangle for cactus for i in range(170, 320):#x for j in range(420, 500):#y data[i, j] = 0 # Draw the rectangle for bird for i in range(170, 320):#x for j in range(400, 420):#y data[i, j] = 170 # Draw the rectangle to find the pixel value for i in range(10, 15):#x for j in range(95, 100):#y data[i, j] = 170 image.show() break '''

            

Here in the while loop, we set the value of Time to day/night according to the pixel value.

Then we change the def cactus (data): like this:

def cactus(data): if Time == 'night': for k in range(170, 320): for l in range(400, 420): if data[k, l] > 100: hit("down") return for k in range(170, 320):#x for l in range(420, 500):#y if data[k, l] > 100: hit("up") return elif Time == 'day': for k in range(170, 320): for l in range(400, 420): if data[k, l] < 100: hit("down") return for k in range(170, 320):#x for l in range(420, 500):#y if data[k, l] < 100: hit("up") return return

Here we find whether it's day or night form the Time variable and then if its day, it jumps or crouches for black pixel(<100) and if it's night it jumps or crouches for the white pixel(>100) 

Note: Experiment with those values to take the program to perfection. 

And we are done.

 

The Full code:

import pyautogui from PIL import Image, ImageGrab import time def hit(key): pyautogui.keyDown(key) return def collide(data): if Time == 'night': for k in range(170, 320): for l in range(400, 420): if data[k, l] > 100: hit("down") return for k in range(170, 320):#x for l in range(420, 500):#y if data[k, l] > 100: hit("up") return elif Time == 'day': for k in range(170, 320): for l in range(400, 420): if data[k, l] < 100: hit("down") return for k in range(170, 320):#x for l in range(420, 500):#y if data[k, l] < 100: hit("up") return return if __name__ == "__main__": time.sleep(2) hit('up') while True: image = ImageGrab.grab().convert('L') data = image.load() for i in range(10, 15):#x for j in range(95, 100):#y if data[i, j] < 201: Time = 'night' elif data[i, j] > 200: Time = 'day' collide(data)

The code for drawing the rectangle:

if __name__ == "__main__": time.sleep(2) while True: image = ImageGrab.grab().convert('L') data = image.load() # Draw the rectangle for cactus for i in range(170, 320):#x for j in range(420, 500):#y data[i, j] = 0 # Draw the rectangle for bird for i in range(170, 320):#x for j in range(400, 420):#y data[i, j] = 170 # Draw the rectangle for time for i in range(10, 15):#x for j in range(95, 100):#y data[i, j] = 170 image.show() break

            If you have any doubts or errors in the program feel free to comment down below and I will respond as early as possible. And if I have made any mistake please correct me in the comment box below. Don't forget to follow us for such python related content.