Merge pull request #110 from devilankur18/emulator_backup_restore

AVD initialisation based on devices xml file

.gitattributes

@@ -0,0 +1 @@
+*.mp4 filter=lfs diff=lfs merge=lfs -text

.github/ISSUE_TEMPLATE.md

@@ -0,0 +1,22 @@
+**Please make sure that it is an issue / a feature request. If it is a question / help wanted, please visit [our group chat](https://gitter.im/butomo1989/docker-android). Thank you!**
+
+Operating System: 
+<!-- OSX Yosemite, Ubuntu 16.04, Windows 10 etc -->
+
+Docker Image:
+<!-- butomo1989/docker-android-x86-7.1.1, butomo1989/docker-android-real-device etc -->
+
+Docker Version:  
+<!-- 17.09.0-ce, 17.06.2-ce etc -->
+
+Docker-compose version (Only if you use it):  
+<!-- 1.16.1 etc -->
+
+Docker Command to start docker-android:  
+<!-- docker run ...  -->
+  
+## Expected Behavior
+<!-- Explaination about expected behaviour goes here -->
+
+## Actual Behavior
+<!-- Explaination about actual behaviour goes here -->

.github/PULL_REQUEST_TEMPLATE.md

@@ -0,0 +1,12 @@
+### Purpose of changes
+<!-- Please describe why this change is required / What problem you want to solve. -->
+
+### Types of changes
+_Put an `x` in the boxes that apply_
+
+- [ ] Bug fix (non-breaking change which fixes an issue)
+- [ ] New feature (non-breaking change which adds functionality)
+- [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
+
+### How has this been tested?
+<!-- Please describe in detail how you tested your changes. -->

.gitignore

@@ -7,6 +7,3 @@
 coverage.xml
 xunit.xml
 coverage/*
-
-# Video
-video*

.travis.yml

@@ -16,6 +16,8 @@ env:
   - ANDROID_VERSION=6.0
   - ANDROID_VERSION=7.0
   - ANDROID_VERSION=7.1.1
+  - ANDROID_VERSION=8.0
+  - ANDROID_VERSION=8.1
   - REAL_DEVICE=True
 
 script: bash travis.sh

README.md

@@ -1,16 +1,22 @@
-Docker-Android
+<p align="center">
-==============
+  <img id="header" src="./images/logo_dockerandroid_small.png" />
+</p>
 
 [![Join the chat at https://gitter.im/butomo1989/docker-android](https://badges.gitter.im/butomo1989/docker-android.svg)](https://gitter.im/butomo1989/docker-android?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge)
 [![Build Status](https://travis-ci.org/butomo1989/docker-android.svg?branch=master)](https://travis-ci.org/butomo1989/docker-android)
+[![Docker Pulls](https://img.shields.io/docker/pulls/butomo1989/docker-android-x86-7.1.1.svg?style=flat-square&style=plastic)](https://hub.docker.com/r/butomo1989/docker-android-x86-7.1.1/)
 [![codecov](https://codecov.io/gh/butomo1989/docker-android/branch/master/graph/badge.svg)](https://codecov.io/gh/butomo1989/docker-android)
 [![Codacy Badge](https://api.codacy.com/project/badge/Grade/3f000ffb97db45a59161814e1434c429)](https://www.codacy.com/app/butomo1989/docker-appium?utm_source=github.com&amp;utm_medium=referral&amp;utm_content=butomo1989/docker-appium&amp;utm_campaign=Badge_Grade)
 
 Docker-Android is a docker image built to be used for everything related to mobile website testing and Android project.
 
-Samsung Device               |  Google Device
+<p align="center">
-:---------------------------:|:---------------------------:
+   <a href="https://youtu.be/pQdpjuYwvp8"><img src="./images/appiumconf2018.png" alt="Appium Conference 2018" width="600"></a>
-![][docker android samsung]  |  ![][docker android nexus]
+</p>
+
+Emulator - Samsung Device    | Emulator - Nexus Device     | Real Device  
+:---------------------------:|:---------------------------:|:---------------------------:
+![][emulator samsung]        |![][emulator nexus]          |![][real device]   
 
 Purpose
 -------
@@ -28,23 +34,24 @@ Advantages compare with other docker-android projects
 2. Emulator for different devices / skins, such as Samsung Galaxy S6, LG Nexus 4, HTC Nexus One and more.
 3. Ability to connect to Selenium Grid
 4. Ability to control emulator from outside container by using adb connect
-5. Open source with more features coming (monkey test, support real devices with screen mirroring and video recording)
+5. Support real devices with screen mirroring
+6. Ability to record video during test execution for debugging
+7. Open source with more features coming
 
 List of Docker images
 ---------------------
 
-|Supported OS   |Android version   |API level   |Image name   |Image status   |
+|OS   |Android   |API   |Browser   |Browser version   |Chromedriver   |Image   |Size   |
-|:---|:---|:---|:---|:---:|
+|:---|:---|:---|:---|:---|:---|:---|:---|
-|Linux|5.0.1|21|butomo1989/docker-android-x86-5.0.1|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-x86-5.0.1.svg)](https://microbadger.com/images/butomo1989/docker-android-x86-5.0.1 "Get your own image badge on microbadger.com")|
+|Linux|5.0.1|21|browser|37.0|2.12|butomo1989/docker-android-x86-5.0.1|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-x86-5.0.1.svg)](https://microbadger.com/images/butomo1989/docker-android-x86-5.0.1 "Get your own image badge on microbadger.com")|
-|Linux|5.1.1|22|butomo1989/docker-android-x86-5.1.1|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-x86-5.1.1.svg)](https://microbadger.com/images/butomo1989/docker-android-x86-5.1.1 "Get your own image badge on microbadger.com")|
+|Linux|5.1.1|22|browser|39.0|2.13|butomo1989/docker-android-x86-5.1.1|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-x86-5.1.1.svg)](https://microbadger.com/images/butomo1989/docker-android-x86-5.1.1 "Get your own image badge on microbadger.com")|
-|Linux|6.0|23|butomo1989/docker-android-x86-6.0|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-x86-6.0.svg)](https://microbadger.com/images/butomo1989/docker-android-x86-6.0 "Get your own image badge on microbadger.com")|
+|Linux|6.0|23|browser|44.0|2.18|butomo1989/docker-android-x86-6.0|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-x86-6.0.svg)](https://microbadger.com/images/butomo1989/docker-android-x86-6.0 "Get your own image badge on microbadger.com")|
-|Linux|7.0|24|butomo1989/docker-android-x86-7.0|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-x86-7.0.svg)](https://microbadger.com/images/butomo1989/docker-android-x86-7.0 "Get your own image badge on microbadger.com")|
+|Linux|7.0|24|chrome|51.0|2.23|butomo1989/docker-android-x86-7.0|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-x86-7.0.svg)](https://microbadger.com/images/butomo1989/docker-android-x86-7.0 "Get your own image badge on microbadger.com")|
-|Linux|7.1.1|25|butomo1989/docker-android-x86-7.1.1|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-x86-7.1.1.svg)](https://microbadger.com/images/butomo1989/docker-android-x86-7.1.1 "Get your own image badge on microbadger.com")|
+|Linux|7.1.1|25|chrome|55.0|2.28|butomo1989/docker-android-x86-7.1.1|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-x86-7.1.1.svg)](https://microbadger.com/images/butomo1989/docker-android-x86-7.1.1 "Get your own image badge on microbadger.com")|
-|OSX / Windows|5.0.1|21|butomo1989/docker-android-arm-5.0.1|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-arm-5.0.1.svg)](https://microbadger.com/images/butomo1989/docker-android-arm-5.0.1 "Get your own image badge on microbadger.com")|
+|Linux|8.0|26|chrome|58.0|2.31|butomo1989/docker-android-x86-8.0|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-x86-8.0.svg)](https://microbadger.com/images/butomo1989/docker-android-x86-8.0 "Get your own image badge on microbadger.com")|
-|OSX / Windows|5.1.1|22|butomo1989/docker-android-arm-5.1.1|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-arm-5.1.1.svg)](https://microbadger.com/images/butomo1989/docker-android-arm-5.1.1 "Get your own image badge on microbadger.com")|
+|Linux|8.1|27|chrome|61.0|2.33|butomo1989/docker-android-x86-8.1|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-x86-8.1.svg)](https://microbadger.com/images/butomo1989/docker-android-x86-8.1 "Get your own image badge on microbadger.com")|
-|OSX / Windows|6.0|23|butomo1989/docker-android-arm-6.0|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-arm-6.0.svg)](https://microbadger.com/images/butomo1989/docker-android-arm-6.0 "Get your own image badge on microbadger.com")|
+|All |-|-|-|-|-|butomo1989/docker-android-real-device|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-real-device.svg)](https://microbadger.com/images/butomo1989/docker-android-real-device "Get your own image badge on microbadger.com")|
-|OSX / Windows|7.0|24|butomo1989/docker-android-arm-7.0|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-arm-7.0.svg)](https://microbadger.com/images/butomo1989/docker-android-arm-7.0 "Get your own image badge on microbadger.com")|
+|Linux|All|All|All|All|All|butomo1989/docker-android-genymotion|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-genymotion.svg)](https://microbadger.com/images/butomo1989/docker-android-genymotion "Get your own image badge on microbadger.com")|
-|OSX / Windows|7.1.1|25|butomo1989/docker-android-arm-7.1.1|[![](https://images.microbadger.com/badges/image/butomo1989/docker-android-arm-7.1.1.svg)](https://microbadger.com/images/butomo1989/docker-android-arm-7.1.1 "Get your own image badge on microbadger.com")|
 
 List of Devices
 ---------------
@@ -71,14 +78,11 @@ Quick Start
 	- For ***Linux OS***, please use image name that contains "x86"
 
 		```bash
-		docker run --privileged -d -p 6080:6080 -p 5554:5554 -p 5555:5555 -e DEVICE="Samsung Galaxy S6" --name android-container butomo1989/docker-android-x86-7.1.1
+		docker run --privileged -d -p 6080:6080 -p 5554:5554 -p 5555:5555 -e DEVICE="Samsung Galaxy S6" --name android-container butomo1989/docker-android-x86-8.1
 		```
 
-	- For ***OSX*** and ***Windows OS***, please use image name that contains "arm"
+	- For ***OSX*** and ***Windows OS***, please use Virtual Machine that support Virtualization with Ubuntu OS
 
-		```bash
-		docker run --privileged -d -p 6080:6080 -p 5554:5554 -p 5555:5555 -e DEVICE="Samsung Galaxy S6" --name android-container butomo1989/docker-android-arm-7.1.1
-		```
 
 2. Verify the ip address of docker host.
 
@@ -95,17 +99,17 @@ Quick Start
 Run Appium Server
 -----------------
 
-Appium is automation test framework to test mobile website and mobile application, including android. To be able to use appium, you need to run appium-server. You run appium server inside docker-android container by ***opening port 4723*** and ***passing an environment variable APPIUM=TRUE***.
+Appium is automation test framework to test mobile website and mobile application, including android. To be able to use appium, you need to run appium-server. You run appium server inside docker-android container by ***opening port 4723*** and ***passing an environment variable APPIUM=true***.
 
 ```bash
-docker run --privileged -d -p 6080:6080 -p 5554:5554 -p 5555:5555 -p 4723:4723 -e DEVICE="Samsung Galaxy S6" -e APPIUM=True --name android-container butomo1989/docker-android-x86-7.1.1
+docker run --privileged -d -p 6080:6080 -p 5554:5554 -p 5555:5555 -p 4723:4723 -e DEVICE="Samsung Galaxy S6" -e APPIUM=true --name android-container butomo1989/docker-android-x86-8.1
 ```
 
 ### Connect to Selenium Grid
 
 It is also possible to connect appium server that run inside docker-android with selenium grid by passing following environment variables:
 
-- CONNECT\_TO\_GRID=True
+- CONNECT\_TO\_GRID=true
 - APPIUM_HOST="\<host\_ip\_address>"
 - APPIUM_PORT=\<port\_number>
 - SELENIUM_HOST="\<host\_ip\_address>"
@@ -113,24 +117,48 @@ It is also possible to connect appium server that run inside docker-android with
 
 To run tests for mobile browser, following parameter can be passed:
 
-- MOBILE\_WEB\_TEST=True
+- MOBILE\_WEB\_TEST=true
 
 ```bash
-docker run --privileged -d -p 6080:6080 -p 4723:4723 -p 5554:5554 -p 5555:5555 -e DEVICE="Samsung Galaxy S6" -e APPIUM=True -e CONNECT_TO_GRID=True -e APPIUM_HOST="127.0.0.1" -e APPIUM_PORT=4723 -e SELENIUM_HOST="172.17.0.1" -e SELENIUM_PORT=4444 -e MOBILE_WEB_TEST=True --name android-container butomo1989/docker-android-x86-7.1.1
+docker run --privileged -d -p 6080:6080 -p 4723:4723 -p 5554:5554 -p 5555:5555 -e DEVICE="Samsung Galaxy S6" -e APPIUM=true -e CONNECT_TO_GRID=true -e APPIUM_HOST="127.0.0.1" -e APPIUM_PORT=4723 -e SELENIUM_HOST="172.17.0.1" -e SELENIUM_PORT=4444 -e MOBILE_WEB_TEST=true --name android-container butomo1989/docker-android-x86-8.1
 ```
 
+### Back & Restore
+If you want to backup/reuse the avds created with furture upgrades or for replication, run the container with two extra mounts
+
+- -v local_backup/.android:/root/.android
+- -v local_backup/android_emulator:/root/android_emulator
+
+```bash
+docker run --privileged -d -p 6080:6080 -p 4723:4723 -p 5554:5554 -p 5555:5555 -v local_backup/.android:/root/.android -v local_backup/android_emulator:local_backup/android_emulator -e DEVICE="Nexus 5" -e APPIUM=true -e CONNECT_TO_GRID=true -e APPIUM_HOST="127.0.0.1" -e APPIUM_PORT=4723 -e SELENIUM_HOST="172.17.0.1" -e SELENIUM_PORT=4444 --name android-container butomo1989/docker-android-x86-8.1
+```
+For the first run, this will create a new avd and all the changes will be accessible in the `local_backup` directory. 
+
+Now for all future runs, it will reuse the avds. Even this should work with new releases of `docker-android`
+
+
 ### Share Volume
 
 If you want to use appium to test UI of your android application, you need to share volume where the APK is located to folder ***/root/tmp***.
 
 ```bash
-docker run --privileged -d -p 6080:6080 -p 4723:4723 -p 5554:5554 -p 5555:5555 -v $PWD/example/sample_apk:/root/tmp -e DEVICE="Nexus 5" -e APPIUM=True -e CONNECT_TO_GRID=True -e APPIUM_HOST="127.0.0.1" -e APPIUM_PORT=4723 -e SELENIUM_HOST="172.17.0.1" -e SELENIUM_PORT=4444 --name android-container butomo1989/docker-android-x86-7.1.1
+docker run --privileged -d -p 6080:6080 -p 4723:4723 -p 5554:5554 -p 5555:5555 -v $PWD/example/sample_apk:/root/tmp -e DEVICE="Nexus 5" -e APPIUM=true -e CONNECT_TO_GRID=true -e APPIUM_HOST="127.0.0.1" -e APPIUM_PORT=4723 -e SELENIUM_HOST="172.17.0.1" -e SELENIUM_PORT=4444 --name android-container butomo1989/docker-android-x86-8.1
 ```
 
+### Video Recording
+
+You can deactivate auto_record by changing the value to "False" in docker-compose file. e.g. change value to "False" in this [line].
+
+### Language
+
+You can change the language setting of Android Emulator on the fly by passing following environment variable:
+
+- LANGUAGE="\<language>"
+- COUNTRY="\<country>"
+
 ### Docker-Compose
 
 ![][compose]
-![][connected_devices]
 
 There is [example of compose file] to run complete selenium grid and docker-android container as nodes. [docker-compose] version [1.13.0] or higher is required to be able to execute that compose file.
 
@@ -138,6 +166,66 @@ There is [example of compose file] to run complete selenium grid and docker-andr
 docker-compose up -d
 ```
 
+### Google Play Services and Google Play Store
+
+The Docker "Android Emulator" images contain Google Play Service (v12.8.74) and Google Play Store (v11.0.50). Both applications are downloaded from [apklinker](https://www.apklinker.com/), so please be aware of it in case you use private/company account to that applications.
+
+Build Android project
+---------------------
+
+docker-android can be used for building Android project and executing its unit test. This following steps will illustrate how to build Android project:
+
+1. Clone [this sample test project](https://github.com/googlesamples/android-testing).
+
+	```bash
+	git clone git@github.com:googlesamples/android-testing.git
+	```
+
+2. Build the project
+
+	```bash
+	docker run -it --rm -v $PWD/android-testing/ui/espresso/BasicSample:/root/tmp butomo1989/docker-android-x86-8.1 tmp/gradlew build
+	```
+
+Proxy
+-----
+
+You can enable proxy inside container by passing following environment variables:
+
+- HTTP_PROXY="\<language>docker\_bridge\_ip\_address>"
+- HTTPS_PROXY="\<docker\_bridge\_ip\_address>"
+- NO_PROXY="localhost"
+
+Relaxed Security
+-----
+
+Pass environment variable RELAXED_SECURITY=true to disable additional security check to use some advanced features.
+
+Genymotion
+----------
+
+![Genymotion](images/logo_genymotion.png)
+
+Docker-Android supports [Genymotion Cloud].
+
+You can easily scale your Appium tests on Genymotion Android virtual devices in the cloud.
+Use [device.json] to define the device to start. You can specify the port on which the device will start so you don't need to change the device name in your tests every time you need to run those tests. Then run following command
+
+```bash
+export USER="xxx"
+export PASS="xxx"
+export LICENSE="xxx"
+
+docker run -it --rm -p 4723:4723 -v $PWD/genymotion/example/sample_devices:/root/tmp -e USER=$USER -e PASS=$PASS -e LICENSE=$LICENSE butomo1989/docker-android-genymotion
+```
+
+You can also use [this docker-compose file].
+
+<p align="center">
+   <a href="https://youtu.be/jXhUEyaVeMY"><img src="./images/Genymotion_cloud.png" alt="Docker-Android supports Genymotion Cloud" width="600"></a>
+</p>
+
+
 Control android emulator outside container
 ------------------------------------------
 
@@ -149,6 +237,15 @@ adb connect <docker-machine-ip-address>:5555
 
 **Note:** You need to have Android Debug Bridge (adb) installed in your host machine.
 
+Get rid of unauthorized device popup while connecting to the emulator outside the container
+------------------------------------------
+
+In order to connect to the emulator using already generated adbkey on your machine you will need to mount your `.android` folder to the container (this is needed only when you work with emulator based on playstore image):
+
+```
+docker run -v <local Android key directory>:/root/.android/ ...
+```
+
 SMS Simulation
 --------------
 
@@ -187,6 +284,77 @@ SMS Simulation
 
 ![][sms]
 
+How to use docker-android in VMWare or Parallels Desktop
+---------------
+The following instructions are used for OS X. You'll need [docker-machine-parallels](https://github.com/Parallels/docker-machine-parallels) to create a virtual machine (vm) with tiny core linux for running docker images. After that, you may start the vm you created for VMWare Fusion or Parallels Desktop and run a docker container inside this vm. If you're going to use the android docker of emulator with x86 processor, setup this vm for nested virtualization and kvm support before you run a docker container.
+
+1. Install docker-machine-parallels via Homebrew:
+    ```bash
+    $ brew install docker-machine-parallels
+    ```
+
+2. Create a virtual machine for running docker images based on the virtual machine tool you use
+
+    2.1. Create a virtual machine of VMWare Fusion
+    ```bash
+    $ docker-machine create --driver=vmwarefusion vmware-dev
+    ```
+
+    2.2. Create a virtual machine of Parallels Desktop
+    ```bash
+    $ docker-machine create --driver=parallels prl-dev
+    ```
+
+    This utility `docker-machine-parallels` will fetch boot2docker.iso to create a vm of VMWare fusion or Parallels Desktop. When the vm is created, you'll see it's booted with VMWare fusion or Parallels Desktop where the network of vm is set to NAT and one IP is assigned. You'll be able to connect to vnc service inside the docker image through that IP. Say it's `10.211.55.3` and we'll use it later.
+
+3. Setup the virtual machine for nested virtualization support
+
+    3.1. Shutdown the vm by running the command below in the boot2docker vm before you setup it.
+    ```bash
+    # shutdown -h now
+    ```
+
+    If you use VMWare Fusion, go to menu bar > Vitual Machine > Settings > Processors and Memory, expand Advanced options, and select `Enable hypervisor applications in this virtual machine`.
+
+    ![Enable nested virtualization for VMWare Fusion](images/vmwarefusion_enable_nested_virtualization.png)
+
+    If you use Parallels Desktop, open settings screen of that vm and go to `CPU & Memory` under `hardware` tab, expand Advanced settings and select `Enable nested virtualization`.
+
+    ![Enable nested virtualization for Parallels Desktop](images/parallels_enable_nested_virtualization.png)
+
+4. Enable kvm inside virtual machine
+    4.1. Run as an account other than root to install kvm packages using tce-load.
+    ```bash
+    # su docker
+    $ tce-load -wi kvm
+    ```
+
+    4.2. Run as root to load kvm module after kvm packages install.
+    ```bash
+    $ sudo modprobe kvm_intel
+    ```
+
+    4.3. Check if the kvm device is loaded.
+    ```bash
+    $ ls /dev/kvm
+    ```
+
+    4.4. Check if your CPU supports hardware virtualization now
+    ```bash
+    $ egrep -c '(vmx|svm)' /proc/cpuinfo
+    ```
+
+    If **0** it means that your CPU doesn't support hardware virtualization.
+    If **1** or more it does - but you still need to make sure that virtualization is enabled in the BIOS.
+
+5. You may now run a docker container
+    5.1. Let's run a docker image for an emulator with x86 processor.
+    ```bash
+    docker run --privileged -d -p 6080:6080 -p 5554:5554 -p 5555:5555 -e DEVICE="Samsung Galaxy S6" --name android-container butomo1989/docker-android-x86-8.1
+    ```
+
+    When the services inside this docker container are running, connect to http://10.211.55.3:6080/vnc.html (the IP we got when the docker machine was created) and login. The emulator with x86 processor should be running on screen.
+
 Troubleshooting
 ---------------
 All logs inside container are stored under folder **/var/log/supervisor**. you can print out log file by using **docker exec**. Example:
@@ -195,15 +363,25 @@ All logs inside container are stored under folder **/var/log/supervisor**. you c
 docker exec -it android-container tail -f /var/log/supervisor/docker-android.stdout.log
 ```
 
+Special Thanks
+--------------
+- [Gian Christanto] for creating a great logo!
+
 [appium]: <https://appium.io>
 [espresso]: <https://google.github.io/android-testing-support-library/docs/espresso/>
 [robotium]: <https://github.com/RobotiumTech/robotium>
-[docker android samsung]: <images/docker_android_samsung.png>
+[emulator samsung]: <images/emulator_samsung_galaxy_s6.png>
-[docker android nexus]: <images/docker_android_nexus.png>
+[emulator nexus]: <images/emulator_nexus_5.png>
+[real device]: <images/real_device.png>
 [compose]: <images/compose.png>
-[connected_devices]: <images/connected_devices.png>
+[line]: <https://github.com/butomo1989/docker-android/blob/master/docker-compose.yml#L70>
 [example of compose file]: <docker-compose.yml>
+[utils bash file]: <src/utils.sh>
 [docker-compose]: <https://docs.docker.com/compose/install/>
 [1.13.0]: <https://github.com/docker/compose/releases/tag/1.13.0>
+[Genymotion Cloud]: <https://www.genymotion.com/cloud/>
+[device.json]: <genymotion/example/sample_devices/devices.json>
+[this docker-compose file]: <genymotion/example/geny.yml>
 [adb_connection]: <images/adb_connection.png>
 [sms]: <images/SMS.png>
+[gian christanto]: <https://www.linkedin.com/in/gian-christanto-0b398b131/>

docker-compose.yml

@@ -6,9 +6,46 @@ version: "2.2"
 services:
   # Selenium hub
   selenium_hub:
-    image: selenium/hub:3.4.0
+    image: selenium/hub:3.12.0-americium
     ports:
-      - "4444:4444"
+      - 4444:4444
+
+  # There is a bug for using appium. Issue: https://github.com/butomo1989/docker-android/issues/73
+  # Real devices
+  #real_device:
+  #  image: butomo1989/docker-android-real-device
+  #  privileged: true
+  #  depends_on:
+  #    - selenium_hub
+  #  ports:
+  #    - 6080:6080
+  #  volumes:
+  #    - ./video-real-device:/tmp/video
+  #    - /dev/bus/usb:/dev/bus/usb
+  #    - ~/.android:/root/.android
+  #  environment:
+  #    - CONNECT_TO_GRID=true
+  #    - APPIUM=true
+  #    - SELENIUM_HOST=selenium_hub
+  #    - AUTO_RECORD=true
+  #    - BROWSER_NAME=chrome
+
+  # Using Appium Docker Android  
+  real_device:
+    image: appium/appium
+    depends_on:
+      - selenium_hub
+    network_mode: "service:selenium_hub"
+    privileged: true
+    volumes:
+      - /dev/bus/usb:/dev/bus/usb
+      - ~/.android:/root/.android
+      - $PWD/example/sample_apk:/root/tmp
+    environment:
+      - CONNECT_TO_GRID=true
+      - SELENIUM_HOST=selenium_hub
+      # Enable it for msite testing
+      #- BROWSER_NAME=chrome
 
   # Docker-Android for Android application testing
   nexus_7.1.1:
@@ -16,37 +53,43 @@ services:
     privileged: true
     # Increase scale number if needed
     scale: 1
+    depends_on:
+      - selenium_hub
+      - real_device
     ports:
       - 6080
     # Change path of apk that you want to test. I use sample_apk that I provide in folder "example"
     volumes:
-      - $PWD/example/sample_apk:/root/tmp
+      - $PWD/example/sample_apk:/root/tmp/sample_apk
       - ./video-nexus_7.1.1:/tmp/video
     environment:
       - DEVICE=Nexus 5
-      - CONNECT_TO_GRID=True
+      - CONNECT_TO_GRID=true
       - APPIUM=true
       - SELENIUM_HOST=selenium_hub
-      - AUTO_RECORD=True
+      - AUTO_RECORD=true
 
   # Docker-Android for mobile website testing with chrome browser
   # Chrome browser exists only for version 7.0 and 7.1.1
   samsung_galaxy_web_7.1.1:
-    image: butomo1989/docker-android-x86-7.1.1
+    image: butomo1989/docker-android-x86-8.1
     privileged: true
     # Increase scale number if needed
     scale: 1
+    depends_on: 
+      - selenium_hub
+      - real_device
     ports:
       - 6080
     volumes:
       - ./video-samsung_7.1.1:/tmp/video
     environment:
       - DEVICE=Samsung Galaxy S6
-      - CONNECT_TO_GRID=True
+      - CONNECT_TO_GRID=true
       - APPIUM=true
       - SELENIUM_HOST=selenium_hub
-      - MOBILE_WEB_TEST=True
+      - MOBILE_WEB_TEST=true
-      - AUTO_RECORD=True
+      - AUTO_RECORD=true
 
   # Docker-Android for mobile website testing with default browser
   # Default browser exists only for version 5.0.1, 5.1.1 and 6.0
@@ -55,14 +98,17 @@ services:
     privileged: true
     # Increase scale number if needed
     scale: 1
+    depends_on:
+      - selenium_hub
+      - real_device
     ports:
       - 6080
     volumes:
       - ./video-samsung_5.1.1:/tmp/video
     environment:
       - DEVICE=Samsung Galaxy S6
-      - CONNECT_TO_GRID=True
+      - CONNECT_TO_GRID=true
       - APPIUM=true
       - SELENIUM_HOST=selenium_hub
-      - MOBILE_WEB_TEST=True
+      - MOBILE_WEB_TEST=true
-      - AUTO_RECORD=True
+      - AUTO_RECORD=true

docker/Emulator_x86

@@ -1,4 +1,4 @@
-FROM appium/appium:1.6.6-beta-p0
+FROM appium/appium:1.8.1-p2
 
 LABEL maintainer "Budi Utomo <budi.ut.1989@gmail.com>"
 
@@ -86,30 +86,40 @@ RUN  wget -nv -O noVNC.zip "https://github.com/kanaka/noVNC/archive/${NOVNC_SHA}
 ARG ANDROID_VERSION=5.0.1
 ARG API_LEVEL=21
 ARG PROCESSOR=x86
-ARG SYS_IMG=x86_64
+ARG SYS_IMG=x86
 ARG IMG_TYPE=google_apis
 ARG BROWSER=android
+ARG CHROME_DRIVER=2.40
+ARG GOOGLE_PLAY_SERVICE=12.8.74
+ARG GOOGLE_PLAY_STORE=11.0.50
 ENV ANDROID_VERSION=$ANDROID_VERSION \
     API_LEVEL=$API_LEVEL \
     PROCESSOR=$PROCESSOR \
     SYS_IMG=$SYS_IMG \
     IMG_TYPE=$IMG_TYPE \
-    BROWSER=$BROWSER
+    BROWSER=$BROWSER \
+    CHROME_DRIVER=$CHROME_DRIVER \
+    GOOGLE_PLAY_SERVICE=$GOOGLE_PLAY_SERVICE \
+    GOOGLE_PLAY_STORE=$GOOGLE_PLAY_STORE
 ENV PATH ${PATH}:${ANDROID_HOME}/build-tools
 
-RUN rm ${ANDROID_HOME}/tools/emulator \
+RUN yes | sdkmanager --licenses && \
- && ln -s ${ANDROID_HOME}/tools/emulator64-${PROCESSOR} ${ANDROID_HOME}/tools/emulator
+    sdkmanager "platforms;android-${API_LEVEL}" "system-images;android-${API_LEVEL};${IMG_TYPE};${SYS_IMG}" "emulator"
-RUN echo y | android update sdk --no-ui -a -t android-${API_LEVEL},sys-img-${SYS_IMG}-${IMG_TYPE}-${API_LEVEL}
 
 #==============================================
-#       Download chrome driver v2.26
+# Download proper version of chromedriver
-# to be able to use chrome browser in emulator
+# to be able to use Chrome browser in emulator
-# Issue: https://github.com/butomo1989/docker-android/commit/6406504f944dae73d0a0c5d8e71a17a47dff9b33
 #==============================================
-RUN wget -nv -O chrome.zip "https://chromedriver.storage.googleapis.com/2.26/chromedriver_linux64.zip" \
+RUN wget -nv -O chrome.zip "https://chromedriver.storage.googleapis.com/${CHROME_DRIVER}/chromedriver_linux64.zip" \
  && unzip -x chrome.zip \
  && rm chrome.zip
 
+#================================================================
+# Download Google Play Services APK and Play Store from apklinker
+#================================================================
+Run wget -nv -O google_play_services.apk "https://www.apklinker.com/wp-content/uploads/uploaded_apk/5b5155e5ef4f8/com.google.android.gms_${GOOGLE_PLAY_SERVICE}-020700-204998136_12874013_MinAPI21_(x86)(nodpi)_apklinker.com.apk"
+Run wget -nv -O google_play_store.apk "https://www.apklinker.com/wp-content/uploads/uploaded_apk/5b632b1164e31/com.android.vending_${GOOGLE_PLAY_STORE}-all-0-PR-206665793_81105000_MinAPI16_(armeabi,armeabi-v7a,mips,mips64,x86,x86_64)(240,320,480dpi)_apklinker.com.apk"
+
 #================================================
 # noVNC Default Configurations
 # These Configurations can be changed through -e
@@ -152,6 +162,6 @@ COPY supervisord.conf /root/
 RUN chmod -R +x /root/src && chmod +x /root/supervisord.conf
 
 HEALTHCHECK --interval=2s --timeout=40s --retries=1 \
-    CMD adb wait-for-device shell 'while [[ -z $(getprop sys.boot_completed) ]]; do sleep 1; done'
+    CMD timeout 40 adb wait-for-device shell 'while [[ -z $(getprop sys.boot_completed) ]]; do sleep 1; done'
 
 CMD /usr/bin/supervisord --configuration supervisord.conf

docker/Genymotion

@@ -1,4 +1,4 @@
-FROM appium/appium:1.6.6-beta-p0
+FROM appium/appium:1.8.1-p2
 
 LABEL maintainer "Budi Utomo <budi.ut.1989@gmail.com>"
 
@@ -17,6 +17,11 @@ WORKDIR /root
 # socat
 #   Port forwarder
 #------------------
+# Genymotion spec
+#------------------
+# bzip2
+#   File compression 
+#------------------
 #  NoVNC Packages
 #------------------
 # x11vnc
@@ -38,9 +43,10 @@ WORKDIR /root
 #   Sed for JSON data
 #==================
 RUN apt-get -qqy update && apt-get -qqy install --no-install-recommends \
-    xterm \
+    xterm \ 
     supervisor \
     socat \
+    bzip2 \
     x11vnc \
     openbox \
     menu \
@@ -67,37 +73,7 @@ RUN  wget -nv -O noVNC.zip "https://github.com/kanaka/noVNC/archive/${NOVNC_SHA}
  && rm websockify.zip \
  && ln noVNC/vnc_auto.html noVNC/index.html
 
-#======================
+#================================================ 
-# Install SDK packages
-#======================
-ARG ANDROID_VERSION=5.0.1
-ARG API_LEVEL=21
-ARG PROCESSOR=x86
-ARG SYS_IMG=x86_64
-ARG IMG_TYPE=google_apis
-ARG BROWSER=android
-ENV ANDROID_VERSION=$ANDROID_VERSION \
-    API_LEVEL=$API_LEVEL \
-    PROCESSOR=$PROCESSOR \
-    SYS_IMG=$SYS_IMG \
-    IMG_TYPE=$IMG_TYPE \
-    BROWSER=$BROWSER
-ENV PATH ${PATH}:${ANDROID_HOME}/build-tools
-
-RUN rm ${ANDROID_HOME}/tools/emulator \
- && ln -s ${ANDROID_HOME}/tools/emulator64-${PROCESSOR} ${ANDROID_HOME}/tools/emulator
-RUN echo y | android update sdk --no-ui -a -t android-${API_LEVEL},sys-img-${SYS_IMG}-${IMG_TYPE}-${API_LEVEL}
-
-#==============================================
-#       Download chrome driver v2.26
-# to be able to use chrome browser in emulator
-# Issue: https://github.com/butomo1989/docker-android/commit/6406504f944dae73d0a0c5d8e71a17a47dff9b33
-#==============================================
-RUN wget -nv -O chrome.zip "https://chromedriver.storage.googleapis.com/2.26/chromedriver_linux64.zip" \
- && unzip -x chrome.zip \
- && rm chrome.zip
-
-#================================================
 # noVNC Default Configurations
 # These Configurations can be changed through -e
 #================================================
@@ -110,7 +86,22 @@ ENV DISPLAY=:0 \
     TARGET_PORT=6080 \
     TIMEOUT=1 \
     VIDEO_PATH=/tmp/video \
-    LOG_PATH=/var/log/supervisor
+    LOG_PATH=/var/log/supervisor 
+
+#====================
+# Install genymotion
+#====================
+ARG GENYMOTION_VERSION=2.12.1
+
+ENV GENYMOTION=true \
+    GENYMOTION_VERSION=$GENYMOTION_VERSION \
+    PATH="${PATH}:/opt/genymobile/genymotion/" \
+    APPIUM_LOG=$LOG_PATH/appium.log
+RUN wget -nv -O genymotion.bin "https://dl.genymotion.com/releases/genymotion-${GENYMOTION_VERSION}/genymotion-${GENYMOTION_VERSION}-linux_x64.bin" \
+ && chmod +x ./genymotion.bin \
+ && yes | ./genymotion.bin \
+ && rm genymotion.bin
+COPY genymotion/generate_config.sh genymotion/geny_start.sh /root/
 
 #===============
 # Expose Ports
@@ -119,26 +110,16 @@ ENV DISPLAY=:0 \
 #   Appium port
 # 6080
 #   noVNC port
-# 5554
-#   Emulator port
 # 5555
 #   ADB connection port
 #===============
-EXPOSE 4723 6080 5554 5555
+EXPOSE 4723 6080 5555
 
-#======================
+#=======================
-# Add Emulator Devices
+# Run docker-genymotion
-#======================
+#=======================
-COPY devices /root/devices
-
-#===================
-# Run docker-appium
-#===================
 COPY src /root/src
 COPY supervisord.conf /root/
-RUN chmod -R +x /root/src && chmod +x /root/supervisord.conf
+RUN chmod -R +x /root/src && chmod +x /root/supervisord.conf /root/geny_start.sh
-
+RUN gmtool --cloud config use_custom_sdk=on sdk_path=/root
-HEALTHCHECK --interval=2s --timeout=40s --retries=1 \
+CMD ["./geny_start.sh"]
-    CMD adb wait-for-device shell 'while [[ -z $(getprop sys.boot_completed) ]]; do sleep 1; done'
-
-CMD /usr/bin/supervisord --configuration supervisord.conf

docker/Real_device

@@ -1,4 +1,4 @@
-FROM appium/appium:1.6.6-beta-p0
+FROM appium/appium:1.8.1-p2
 
 LABEL maintainer "Budi Utomo <budi.ut.1989@gmail.com>"
 
@@ -38,7 +38,7 @@ WORKDIR /root
 #   Sed for JSON data
 #==================
 RUN apt-get -qqy update && apt-get -qqy install --no-install-recommends \
-    xterm \
+    xterm \ 
     supervisor \
     socat \
     x11vnc \
@@ -67,14 +67,7 @@ RUN  wget -nv -O noVNC.zip "https://github.com/kanaka/noVNC/archive/${NOVNC_SHA}
  && rm websockify.zip \
  && ln noVNC/vnc_auto.html noVNC/index.html
 
-#==============================================
+#================================================ 
-# Download Adb remote screen
-#==============================================
-RUN wget -nv -O asm.zip "http://adakoda.github.io/android-screen-monitor/download/3.0.0/ASM_3_00.zip" \
- && unzip asm.zip \
- && rm asm.zip
-
-#================================================
 # noVNC Default Configurations
 # These Configurations can be changed through -e
 #================================================
@@ -92,7 +85,8 @@ ENV DISPLAY=:0 \
 #=========================
 # Set default variables
 #=========================
-ENV REAL_DEVICE=True
+ENV APPIUM_LOG=$LOG_PATH/appium.log
+ENV REAL_DEVICE=true
 ENV BROWSER=android
 
 #===============
@@ -110,6 +104,7 @@ EXPOSE 4723 6080 5555
 #===================
 # Run docker-appium
 #===================
+COPY sm/asm.jar /root/
 COPY src /root/src
 COPY supervisord.conf /root/
 RUN chmod -R +x /root/src && chmod +x /root/supervisord.conf

genymotion/example/geny.yml

@@ -0,0 +1,29 @@
+# Note: It requires docker-compose 1.13.0
+#
+# Usage: docker-compose up -d
+version: "2.2"
+
+services:
+  # Selenium hub
+  selenium_hub:
+    image: selenium/hub:3.12.0-americium
+    ports:
+      - 4444:4444
+
+  # Please stop this container by using docker stop instead of docker-compose stop
+  genymotion:
+    image: butomo1989/docker-android-genymotion
+    depends_on:
+      - selenium_hub
+    ports:
+      - 6080:6080
+      - 4723:4723
+    volumes:
+      - $PWD/sample_apk:/root/tmp/sample_apk
+      - $PWD/sample_devices:/root/tmp
+    environment:
+      - GENY_TEMPLATE=/root/tmp/devices.json
+      - USER=xxx
+      - PASS=xxx
+      - LICENSE=xxx
+      - CONNECT_TO_GRID=true

genymotion/example/sample_devices/devices.json

@@ -0,0 +1,11 @@
+[
+	{
+		"template": "Samsung Galaxy S7 - 6.0.0 - API 23 - 1440x2560",
+		"device": "SamsungS7V6",
+		"port": 38727
+	},
+	{
+		"template": "Google Nexus 6 - 8.0 - API 26 - 1440x2560",
+		"device": "Nexus6V8"
+	}
+]

genymotion/generate_config.sh

@@ -0,0 +1,81 @@
+#!/bin/bash
+
+node_config_json=$1
+
+if [ -z "$PLATFORM_NAME" ]; then
+  PLATFORM_NAME="Android"
+fi
+
+if [ -z "$APPIUM_HOST" ]; then
+  APPIUM_HOST=$(hostname -i)
+fi
+
+if [ -z "$APPIUM_PORT" ]; then
+  APPIUM_PORT=4723
+fi
+
+if [ -z "$SELENIUM_HOST" ]; then
+  SELENIUM_HOST="172.17.0.1"
+fi
+
+if [ -z "$SELENIUM_PORT" ]; then
+  SELENIUM_PORT=4444
+fi
+
+if [ -z "$BROWSER_NAME" ]; then
+  BROWSER_NAME="android"
+fi
+
+if [ -z "$NODE_TIMEOUT" ]; then
+  NODE_TIMEOUT=300
+fi
+
+#Get device names
+devices=($(adb devices | grep -oP "\K([^ ]+)(?=\sdevice(\W|$))"))
+echo "Devices found: ${#devices[@]}"
+
+#Create capabilities json configs
+function create_capabilities() {
+  capabilities=""
+  for name in ${devices[@]}; do
+    os_version="$(adb -s $name shell getprop ro.build.version.release | tr -d '\r')"
+    capabilities+=$(cat <<_EOF
+{
+    "platform": "$PLATFORM_NAME",
+    "platformName": "$PLATFORM_NAME",
+    "version": "$os_version",
+    "browserName": "$BROWSER_NAME",
+    "deviceName": "$name",
+    "maxInstances": 1,
+    "applicationName": "$name"
+  }
+_EOF
+    )
+    if [ ${devices[-1]} != $name ]; then
+      capabilities+=', '
+    fi
+  done
+  echo "$capabilities"
+}
+
+#Final node configuration json string
+nodeconfig=$(cat <<_EOF
+{
+  "capabilities": [$(create_capabilities)],
+  "configuration": {
+    "cleanUpCycle": 2000,
+    "timeout": $NODE_TIMEOUT,
+    "proxy": "org.openqa.grid.selenium.proxy.DefaultRemoteProxy",
+    "url": "http://$APPIUM_HOST:$APPIUM_PORT/wd/hub",
+    "host": "$APPIUM_HOST",
+    "port": $APPIUM_PORT,
+    "maxSession": 6,
+    "register": true,
+    "registerCycle": 5000,
+    "hubHost": "$SELENIUM_HOST",
+    "hubPort": $SELENIUM_PORT
+  }
+}
+_EOF
+)
+echo "$nodeconfig" > $node_config_json

genymotion/geny_start.sh

@@ -0,0 +1,29 @@
+#!/bin/bash
+# This script is needed because of https://www.ctl.io/developers/blog/post/gracefully-stopping-docker-containers/
+
+if [ -z "$GENY_TEMPLATE" ]; then
+  	GENY_TEMPLATE="/root/tmp/devices.json"
+fi
+
+if [ ! -f "$GENY_TEMPLATE" ]; then
+    echo "File not found! Nothing to do!"
+    exit 1
+fi
+
+getAbort() {
+    if [ "$GENYMOTION" = true ]; then
+        contents=$(cat $GENY_TEMPLATE)
+        echo "ABORT SIGNAL detected! Stopping all created emulators..."
+        for row in $(echo "${contents}" | jq -r '.[] | @base64'); do
+            get_value() {
+                echo ${row} | base64 --decode | jq -r ${1}
+            }
+
+            gmtool --cloud admin stopdisposable $(get_value '.device')
+        done
+        echo "Done"
+    fi
+}
+trap 'getAbort; exit' EXIT
+
+/usr/bin/supervisord --configuration supervisord.conf

release.sh

@@ -10,21 +10,15 @@ else
 fi
 
 if [ -z "$2" ]; then
-    read -p "Android version (5.0.1|5.1.1|6.0|7.0|7.1.1|all): " ANDROID_VERSION
+    read -p "Android version (5.0.1|5.1.1|6.0|7.0|7.1.1|8.0|8.1|all): " ANDROID_VERSION
 else
     ANDROID_VERSION=$2
 fi
 
 if [ -z "$3" ]; then
-    read -p "Processor type (x86|arm|all): " PROCESSOR
-else
-    PROCESSOR=$3
-fi
-
-if [ -z "$4" ]; then
     read -p "Release version: " RELEASE
 else
-    RELEASE=$4
+    RELEASE=$3
 fi
 
 declare -A list_of_levels=(
@@ -33,11 +27,20 @@ declare -A list_of_levels=(
         [6.0]=23
         [7.0]=24
         [7.1.1]=25
+        [8.0]=26
+        [8.1]=27
 )
 
-declare -A list_of_processors=(
+# The version of the Chrome browser installed on the Android emulator needs to be known beforehand
-        [arm]=armeabi-v7a
+# in order to chose the proper version of chromedriver (see http://chromedriver.chromium.org/downloads)
-        [x86]=x86_64
+declare -A chromedriver_versions=(
+        [5.0.1]="2.12"
+        [5.1.1]="2.13"
+        [6.0]="2.18"
+        [7.0]="2.23"
+        [7.1.1]="2.28"
+        [8.0]="2.31"
+        [8.1]="2.33"
 )
 
 function get_android_versions() {
@@ -57,46 +60,22 @@ function get_android_versions() {
 
     # If version cannot be found in the list
     if [ -z "$versions" ]; then
-        echo "Android version \"$ANDROID_VERSION\" is not found in the list or not supported! Support only version 5.0.1, 5.1.1, 6.0, 7.0, 7.1.1"
+        echo "Android version \"$ANDROID_VERSION\" is not found in the list or not supported! Support only version 5.0.1, 5.1.1, 6.0, 7.0, 7.1.1, 8.0, 8.1"
         exit 1
     fi
 
     echo "Android versions: ${versions[@]}"
 }
 
-function get_processors() {
-    processors=()
-
-    if [ "$PROCESSOR" == "all" ]; then
-        for key in "${!list_of_processors[@]}"; do
-            processors+=($key)
-        done
-    else
-        for key in "${!list_of_processors[@]}"; do
-            if [[ $key == *"$PROCESSOR"* ]]; then
-                processors+=($key)
-            fi
-        done
-    fi
-
-    # If version cannot be found in the list
-    if [ -z "$processors" ]; then
-        echo "Invalid processor \"$PROCESSOR\"! Valid options: x86, arm"
-        exit 1
-    fi
-
-    echo "Processors: ${processors[@]}"
-}
-
 get_android_versions
-get_processors
+processor=x86
 
 function test() {
     # Prepare needed parameter to run tests
     test_android_version=7.1.1
     test_api_level=25
     test_processor=x86
-    test_sys_img=x86_64
+    test_sys_img=$test_processor
     test_img_type=google_apis
     test_browser=chrome
     test_image=test_img
@@ -152,54 +131,49 @@ function build() {
     # Remove pyc files
     find . -name "*.pyc" -exec rm -f {} \;
 
-    # Build docker image(s)
+    # Build docker image
-    for p in "${processors[@]}"; do
+    FILE_NAME=docker/Emulator_x86
-        if [ "$p" == "x86" ]; then
-            FILE_NAME=docker/Emulator_x86
-        else
-            FILE_NAME=docker/Emulator_arm
-        fi
 
-        for v in "${versions[@]}"; do
+    for v in "${versions[@]}"; do
-            # Find image type and default web browser
+        # Find image type and default web browser
-            if [ "$v" == "5.0.1" ] || [ "$v" == "5.1.1" ]; then
+        if [ "$v" == "5.0.1" ] || [ "$v" == "5.1.1" ]; then
-                IMG_TYPE=android
+            IMG_TYPE=default
-                BROWSER=browser
+            BROWSER=browser
-            elif [ "$v" == "6.0" ]; then
+        elif [ "$v" == "6.0" ]; then
-                # It is because there is no ARM EABI v7a System Image for 6.0
+            # It is because there is no ARM EABI v7a System Image for 6.0
-                IMG_TYPE=google_apis
+            IMG_TYPE=google_apis
-                BROWSER=browser
+            BROWSER=browser
-            else
+        else
-                IMG_TYPE=google_apis
+            #adb root cannot be run in IMG_TYPE=google_apis_playstore 
-                BROWSER=chrome
+            IMG_TYPE=google_apis
-            fi
+            BROWSER=chrome
-            echo "[BUILD] IMAGE TYPE: $IMG_TYPE"
+        fi
-            level=${list_of_levels[$v]}
+        echo "[BUILD] IMAGE TYPE: $IMG_TYPE"
-            echo "[BUILD] API Level: $level"
+        level=${list_of_levels[$v]}
-            sys_img=${list_of_processors[$p]}
+        echo "[BUILD] API Level: $level"
-            echo "[BUILD] System Image: $sys_img"
+        sys_img=$processor
-            image_version="$IMAGE-$p-$v:$RELEASE"
+        echo "[BUILD] System Image: $sys_img"
-            image_latest="$IMAGE-$p-$v:latest"
+        chrome_driver="${chromedriver_versions[$v]}"
-            echo "[BUILD] Image name: $image_version and $image_latest"
+        echo "[BUILD] chromedriver version: $chrome_driver"
-            echo "[BUILD] Dockerfile: $FILE_NAME"
+        image_version="$IMAGE-$processor-$v:$RELEASE"
-            docker build -t $image_version --build-arg ANDROID_VERSION=$v --build-arg API_LEVEL=$level \
+        image_latest="$IMAGE-$processor-$v:latest"
-            --build-arg PROCESSOR=$p --build-arg SYS_IMG=$sys_img --build-arg IMG_TYPE=$IMG_TYPE \
+        echo "[BUILD] Image name: $image_version and $image_latest"
-            --build-arg BROWSER=$BROWSER -f $FILE_NAME .
+        echo "[BUILD] Dockerfile: $FILE_NAME"
-            docker tag $image_version $image_latest
+        docker build -t $image_version --build-arg ANDROID_VERSION=$v --build-arg API_LEVEL=$level \
-        done
+        --build-arg PROCESSOR=$processor --build-arg SYS_IMG=$sys_img --build-arg IMG_TYPE=$IMG_TYPE \
+        --build-arg BROWSER=$BROWSER --build-arg CHROME_DRIVER=$chrome_driver -f $FILE_NAME .
+        docker tag $image_version $image_latest
     done
 }
 
 function push() {
     # Push docker image(s)
-    for p in "${processors[@]}"; do
+    for v in "${versions[@]}"; do
-        for v in "${versions[@]}"; do
+        image_version="$IMAGE-$processor-$v:$RELEASE"
-            image_version="$IMAGE-$p-$v:$RELEASE"
+        image_latest="$IMAGE-$processor-$v:latest"
-            image_latest="$IMAGE-$p-$v:latest"
+        echo "[PUSH] Image name: $image_version and $image_latest"
-            echo "[PUSH] Image name: $image_version and $image_latest"
+        docker push $image_version
-            docker push $image_version
+        docker push $image_latest
-            docker push $image_latest
-        done
     done
 }
 

revert.sh

@@ -0,0 +1,29 @@
+#!/bin/bash
+
+IMAGE_NAME="butomo1989/docker-android"
+
+if [ -z "$1" ]; then
+    read -p "Type : " TYPE
+else
+    TYPE=$1
+fi
+
+if [ -z "$2" ]; then
+    read -p "Version : " VERSION
+else
+    VERSION=$2
+fi
+
+declare -a versions=("7.1.1" "7.0" "6.0" "5.1.1" "5.0.1")
+
+## now loop through the above array
+for v in "${versions[@]}"
+do
+	IMAGE="$IMAGE_NAME-$TYPE-$v"
+	IMAGE_OLD="$IMAGE:$VERSION"
+	IMAGE_LATEST="$IMAGE:latest"
+	echo "Revert image \"$IMAGE_LATEST\" to version \"$IMAGE_OLD\""
+	docker pull $IMAGE_OLD
+	docker tag $IMAGE_OLD $IMAGE_LATEST
+	docker push $IMAGE_LATEST
+done

src/app.py

@@ -4,22 +4,25 @@ import json
 import logging
 import os
 import subprocess
-import errno
+import uuid
 
-from src import CONFIG_FILE, ROOT, CHROME_DRIVER
+from src import CHROME_DRIVER, CONFIG_FILE, ROOT
 from src import log
 
 log.init()
 logger = logging.getLogger('app')
 
+
 def symlink_force(target, link_name):
     try:
         os.symlink(target, link_name)
     except OSError as e:
+        import errno
         if e.errno == errno.EEXIST:
             os.remove(link_name)
             os.symlink(target, link_name)
 
+
 def get_or_raise(env: str) -> str:
     """
     Check if needed environment variables are given.
@@ -47,6 +50,9 @@ def convert_str_to_bool(str: str) -> bool:
         logger.error(err)
 
 
+def is_initialized() -> bool:
+    return os.path.exists(os.path.join(ROOT, '.android', 'devices.xml'))
+
 ANDROID_HOME = get_or_raise('ANDROID_HOME')
 ANDROID_VERSION = get_or_raise('ANDROID_VERSION')
 API_LEVEL = get_or_raise('API_LEVEL')
@@ -69,22 +75,9 @@ def prepare_avd(device: str, avd_name: str):
     :param device: Device name
     :param avd_name: Name of android virtual device / emulator
     """
-    cmd = 'echo no | android create avd -f -n {name} -t android-{api} -b {img_type}{sys_img}'.format(
-        name=avd_name, api=API_LEVEL, img_type='google_apis/' if IMG_TYPE == 'google_apis' else '',
-        sys_img=SYS_IMG)
 
-    # Link emulator skins
-    skin_rsc_path = os.path.join(ROOT, 'devices', 'skins')
-    logger.info('Skin ressource path: {rsc}'.format(rsc=skin_rsc_path))
-    skin_dst_path = os.path.join(ANDROID_HOME, 'platforms', 'android-{api}'.format(api=API_LEVEL), 'skins')
-    logger.info('Skin destination path: {dst}'.format(dst=skin_dst_path))
-    for s in os.listdir(skin_rsc_path):
-        symlink_force(os.path.join(skin_rsc_path, s), os.path.join(skin_dst_path, s))
-
-    # Hardware and its skin
     device_name_bash = device.replace(' ', '\ ')
     skin_name = device.replace(' ', '_').lower()
-    logger.info('Device name in bash: {db}, Skin name: {skin}'.format(db=device_name_bash, skin=skin_name))
 
     # For custom hardware profile
     profile_dst_path = os.path.join(ROOT, '.android', 'devices.xml')
@@ -95,10 +88,20 @@ def prepare_avd(device: str, avd_name: str):
         logger.info('Hardware profile destination path: {dst}'.format(dst=profile_dst_path))
         symlink_force(profile_src_path, profile_dst_path)
 
-    # Append command
+    avd_path = '/'.join([ANDROID_HOME, 'android_emulator'])
-    cmd += ' -d {device} -s {skin}'.format(device=device_name_bash, skin=skin_name)
+    creation_cmd = 'avdmanager create avd -f -n {name} -b {img_type}/{sys_img} -k "system-images;android-{api_lvl};' \
-    logger.info('AVD creation command: {cmd}'.format(cmd=cmd))
+                   '{img_type};{sys_img}" -d {device} -p {path}'.format(name=avd_name, img_type=IMG_TYPE,
-    subprocess.check_call(cmd, shell=True)
+                                                                        sys_img=SYS_IMG,
+                                                                        api_lvl=API_LEVEL, device=device_name_bash,
+                                                                        path=avd_path)
+    logger.info('Command to create avd: {command}'.format(command=creation_cmd))
+    subprocess.check_call(creation_cmd, shell=True)
+
+    skin_path = '/'.join([ANDROID_HOME, 'devices', 'skins', skin_name])
+    config_path = '/'.join([avd_path, 'config.ini'])
+    with open(config_path, 'a') as file:
+        file.write('skin.path={sp}'.format(sp=skin_path))
+    logger.info('Skin was added in config.ini')
 
 
 def appium_run(avd_name: str):
@@ -107,11 +110,16 @@ def appium_run(avd_name: str):
 
     :param avd_name: Name of android virtual device / emulator
     """
-    cmd = 'appium'
+    DEFAULT_LOG_PATH = '/var/log/supervisor/appium.log'
+    cmd = 'appium --log {log}'.format(log=os.getenv('APPIUM_LOG', DEFAULT_LOG_PATH))
+
+    relaxed_security = convert_str_to_bool(str(os.getenv('RELAXED_SECURITY', False)))
+    logger.info('Relaxed security? {rs}'.format(rs=relaxed_security))
+    if relaxed_security:
+        cmd += ' --relaxed-security'
 
     default_web_browser = os.getenv('BROWSER')
-    if default_web_browser == 'chrome':
+    cmd += ' --chromedriver-executable {driver}'.format(driver=CHROME_DRIVER)
-        cmd += ' --chromedriver-executable {driver}'.format(driver=CHROME_DRIVER)
 
     grid_connect = convert_str_to_bool(str(os.getenv('CONNECT_TO_GRID', False)))
     logger.info('Connect to selenium grid? {connect}'.format(connect=grid_connect))
@@ -178,20 +186,34 @@ def run():
     """Run app."""
     device = os.getenv('DEVICE', 'Nexus 5')
     logger.info('Device: {device}'.format(device=device))
+    device_id = os.getenv('DEVICE_ID', str(uuid.uuid4()))
+    logger.info('Device Id: {device_id}'.format(device_id=device_id))
 
     avd_name = '{device}_{version}'.format(device=device.replace(' ', '_').lower(), version=ANDROID_VERSION)
     logger.info('AVD name: {avd}'.format(avd=avd_name))
+    is_first_run = not is_initialized()
+
+    if is_first_run:
+        logger.info('Preparing emulator...')
+        prepare_avd(device, avd_name)
 
-    logger.info('Preparing emulator...')
-    prepare_avd(device, avd_name)
     logger.info('Run emulator...')
-    cmd = 'emulator -avd {name}'.format(name=avd_name)
+    dp_size = os.getenv('DATAPARTITION', '550m')
-    subprocess.Popen(cmd.split())
+    with open("/root/android_emulator/config.ini", "a") as cfg:
+        cfg.write('\ndisk.dataPartition.size={dp}'.format(dp=dp_size))
 
+    if is_first_run:
+        cmd = 'emulator/emulator @{name} -gpu off -prop emu.uuid={uuid} -verbose -wipe-data'.format(name=avd_name, uuid=device_id)
+    else:
+        cmd = 'emulator/emulator @{name} -gpu off -prop emu.uuid={uuid} -verbose'.format(name=avd_name, uuid=device_id)
     appium = convert_str_to_bool(str(os.getenv('APPIUM', False)))
     if appium:
+        subprocess.Popen(cmd.split())
         logger.info('Run appium server...')
         appium_run(avd_name)
+    else:
+        result = subprocess.Popen(cmd.split(), stdout=subprocess.PIPE).communicate()
+
 
 if __name__ == '__main__':
     run()

src/appium.sh

@@ -1,13 +1,62 @@
 #!/bin/bash
 
-if [ -z $REAL_DEVICE ]; then
+if [ -z "$GENY_TEMPLATE" ]; then
-  python3 -m src.app
+  	GENY_TEMPLATE="/root/tmp/devices.json"
+fi
+
+function prepare_geny_cloud() {
+	contents=$(cat $GENY_TEMPLATE)
+
+	# Register
+	gmtool config username="${USER}" password="${PASS}"
+	gmtool license register "${LICENSE}"
+
+	# Start device(s)
+	echo "Creating device(s) based on given json file..."
+	for row in $(echo "${contents}" | jq -r '.[] | @base64'); do
+		get_value() {
+			echo ${row} | base64 --decode | jq -r ${1}
+    	}
+
+	    template=$(get_value '.template')
+	    device=$(get_value '.device')
+	    port=$(get_value '.port')
+
+	    if [[ $port != null ]]; then
+	    	echo "Starting \"$device\" with template name \"$template\" on port \"$port\"..."
+	    	gmtool --cloud admin startdisposable "${template}" "${device}" --adb-serial-port "${port}"
+	    else
+	    	echo "Starting \"$device\" with template name \"$template\"..."
+			gmtool --cloud admin startdisposable "${template}" "${device}"
+	    fi
+	done
+}
+
+function run_appium() {
+	echo "Preparing appium-server..."
+	CMD="appium --log $APPIUM_LOG"
+	if [ "$CONNECT_TO_GRID" = true ]; then
+		NODE_CONFIG_JSON="/root/src/nodeconfig.json"
+		/root/generate_config.sh $NODE_CONFIG_JSON
+		CMD+=" --nodeconfig $NODE_CONFIG_JSON"
+  	fi
+
+	if [ "$RELAXED_SECURITY" = true ]; then
+		CMD+=" --relaxed-security"
+	fi
+
+	echo "Preparation is done"
+  	$CMD
+}
+
+if [ "$REAL_DEVICE" = true ]; then
+	echo "Using real device"
+	run_appium
+elif [ "$GENYMOTION" = true ]; then
+	echo "Using Genymotion"
+	prepare_geny_cloud
+	run_appium
 else
-  CMD="appium"
+	echo "Using Emulator"
-  if [ ! -z "$CONNECT_TO_GRID" ]; then
+	python3 -m src.app
-    NODE_CONFIG_JSON="/root/src/nodeconfig.json"
-    /root/generate_config.sh $NODE_CONFIG_JSON
-    CMD+=" --nodeconfig $NODE_CONFIG_JSON"
-  fi
-  $CMD
 fi

src/record.sh

@@ -16,12 +16,12 @@ function auto_record() {
     echo "Auto record: $AUTO_RECORD"
     sleep 6
 
-    while [ $AUTO_RECORD == "True" ]; do
+    while [ "$AUTO_RECORD" = true ]; do
         # Check if there is test running
         no_test=true
         while $no_test; do
             task=$(curl -s localhost:4723/wd/hub/sessions | jq -r '.value')
-            if [ "$task" == "" ] || [ "$task" == "[]" ]; then
+            if [ "$task" = "" ] || [ "$task" = "[]" ]; then
                 sleep .5
             else
                 start &
@@ -30,9 +30,9 @@ function auto_record() {
         done
 
         # Check if test is finished
-        while [ $no_test == false ]; do
+        while [ $no_test = false ]; do
             task=$(curl -s localhost:4723/wd/hub/sessions | jq -r '.value')
-            if [ "$task" == "" ] || [ "$task" == "[]" ]; then
+            if [ "$task" = "" ] || [ "$task" = "[]" ]; then
                 stop
                 no_test=true
             else

src/tests/unit/test_app.py

@@ -10,22 +10,24 @@ from src import app
 class TestApp(TestCase):
     """Unit test class to test other methods in the app."""
 
-    #create symlink
     @classmethod
-    def test_symlink_correct(self):
+    def test_symlink(self):
-        os.mknod(os.path.join("./","testFile1.txt"))
+        res = os.path.join('testFile1.txt')
-        app.symlink_force(os.path.join("./","testFile1.txt"),os.path.join("./","link_testFile1.txt"))
+        dest = os.path.join('link_testFile1.txt')
-        os.remove(os.path.join("./","testFile1.txt"))
+        open(res, 'a').close()
-        os.remove(os.path.join("./","link_testFile1.txt"))
+        app.symlink_force(res, dest)
+        os.remove(res)
+        os.remove(dest)
 
-    #link already exist
     @classmethod
     def test_symlink_already_exist(self):
-        os.mknod(os.path.join("./","testFile2.txt"))
+        res = os.path.join('testFile1.txt')
-        os.mknod(os.path.join("./","link_testFile2.txt"))
+        dest = os.path.join('link_testFile1.txt')
-        app.symlink_force(os.path.join("./","testFile2.txt"),os.path.join("./","link_testFile2.txt"))
+        open(res, 'a').close()
-        os.remove(os.path.join("./","testFile2.txt"))
+        open(dest, 'a').close()
-        os.remove(os.path.join("./","link_testFile2.txt"))
+        app.symlink_force(res, dest)
+        os.remove(res)
+        os.remove(dest)
 
     def test_valid_env(self):
         key = 'ENV_1'
@@ -51,21 +53,43 @@ class TestApp(TestCase):
         self.assertEqual(app.convert_str_to_bool(True), None)
 
     @mock.patch('src.app.prepare_avd')
+    @mock.patch('builtins.open')
     @mock.patch('subprocess.Popen')
-    def test_run_with_appium(self, mocked_avd, mocked_subprocess):
+    def test_run_with_appium(self, mocked_avd, mocked_open, mocked_subprocess):
         with mock.patch('src.app.appium_run') as mocked_appium:
             os.environ['APPIUM'] = str(True)
             app.run()
             self.assertTrue(mocked_avd.called)
+            self.assertTrue(mocked_open.called)
             self.assertTrue(mocked_subprocess.called)
             self.assertTrue(mocked_appium.called)
 
     @mock.patch('src.app.prepare_avd')
+    @mock.patch('builtins.open')
     @mock.patch('subprocess.Popen')
-    def test_run_withhout_appium(self, mocked_avd, mocked_subprocess):
+    def test_run_without_appium(self, mocked_avd, mocked_open, mocked_subprocess):
         with mock.patch('src.app.appium_run') as mocked_appium:
             os.environ['APPIUM'] = str(False)
             app.run()
             self.assertTrue(mocked_avd.called)
+            self.assertTrue(mocked_open.called)
             self.assertTrue(mocked_subprocess.called)
             self.assertFalse(mocked_appium.called)
+
+    @mock.patch('builtins.open')
+    @mock.patch('subprocess.Popen')
+    @mock.patch('os.path.exists', mock.MagicMock(return_value=False))
+    def test_run_first_run(self, mocked_open, mocked_subprocess):
+        with mock.patch('src.app.prepare_avd') as mocked_prepare_avd:
+            app.run()
+            self.assertFalse(app.is_initialized())
+            self.assertTrue(mocked_prepare_avd.called)
+
+    @mock.patch('builtins.open')
+    @mock.patch('subprocess.Popen')
+    @mock.patch('os.path.exists', mock.MagicMock(return_value=True))
+    def test_run_next_run(self, mocked_open, mocked_subprocess):
+        with mock.patch('src.app.prepare_avd') as mocked_prepare_avd:
+            app.run()
+            self.assertTrue(app.is_initialized())
+            self.assertFalse(mocked_prepare_avd.called)

src/tests/unit/test_avd.py

@@ -8,34 +8,30 @@ from src import app
 
 
 @mock.patch('subprocess.check_call')
-@mock.patch('os.symlink')
 class TestAvd(TestCase):
     """Unit test class to test method create_avd."""
 
     def setUp(self):
         self.avd_name = 'test_avd'
 
-    def test_nexus_avd_as_default(self, mocked_suprocess, mocked_sys_link):
+    @mock.patch("builtins.open", create=True)
-        with mock.patch('os.listdir') as mocked_list_dir:
+    def test_nexus_avd_as_default(self, mocked_suprocess, mocked_open):
-            mocked_list_dir.return_value = ['file1', 'file2']
+        self.assertFalse(mocked_suprocess.called)
-            self.assertFalse(mocked_list_dir.called)
+        self.assertFalse(mocked_open.called)
-            self.assertFalse(mocked_sys_link.called)
+        app.prepare_avd('Nexus 5', self.avd_name)
-            self.assertFalse(mocked_suprocess.called)
+        self.assertTrue(mocked_suprocess.called)
-            app.prepare_avd('Nexus 5', self.avd_name)
+        self.assertTrue(mocked_open.called)
-            self.assertTrue(mocked_list_dir.called)
-            self.assertTrue(mocked_sys_link.called)
-            self.assertTrue(mocked_suprocess.called)
 
-    def test_samsung_avd(self, mocked_suprocess, mocked_sys_link):
+    @mock.patch('os.symlink')
-        with mock.patch('os.listdir') as mocked_list_dir:
+    @mock.patch("builtins.open", create=True)
-            mocked_list_dir.return_value = ['file1', 'file2']
+    def test_samsung_avd(self, mocked_suprocess, mocked_sys_link, mocked_open):
-            self.assertFalse(mocked_list_dir.called)
+        self.assertFalse(mocked_sys_link.called)
-            self.assertFalse(mocked_sys_link.called)
+        self.assertFalse(mocked_suprocess.called)
-            self.assertFalse(mocked_suprocess.called)
+        self.assertFalse(mocked_open.called)
-            app.prepare_avd('Samsung Galaxy S6', self.avd_name)
+        app.prepare_avd('Samsung Galaxy S6', self.avd_name)
-            self.assertTrue(mocked_list_dir.called)
+        self.assertTrue(mocked_sys_link.called)
-            self.assertTrue(mocked_sys_link.called)
+        self.assertTrue(mocked_suprocess.called)
-            self.assertTrue(mocked_suprocess.called)
+        self.assertTrue(mocked_open.called)
 
     def tearDown(self):
         if os.getenv('DEVICE'):

src/utils.sh

@@ -0,0 +1,44 @@
+#!/bin/bash
+
+function wait_emulator_to_be_ready () {
+  boot_completed=false
+  while [ "$boot_completed" == false ]; do
+    status=$(adb wait-for-device shell getprop sys.boot_completed | tr -d '\r')
+    echo "Boot Status: $status"
+
+    if [ "$status" == "1" ]; then
+      boot_completed=true
+    else
+      sleep 1
+    fi      
+  done
+}
+
+function change_language_if_needed() {
+  if [ ! -z "${LANGUAGE// }" ] && [ ! -z "${COUNTRY// }" ]; then
+    wait_emulator_to_be_ready
+    echo "Languge will be changed to ${LANGUAGE}-${COUNTRY}"
+    adb root && adb shell "setprop persist.sys.language $LANGUAGE; setprop persist.sys.country $COUNTRY; stop; start"
+    echo "Language is changed!"
+  fi
+}
+
+function install_google_play () {
+  wait_emulator_to_be_ready
+  echo "Google Play Service will be installed"
+  adb install -r "/root/google_play_services.apk"
+  echo "Google Play Store will be installed"
+  adb install -r "/root/google_play_store.apk"
+}
+
+function disable_animation () {
+  # To improve performance
+  adb shell "settings put global window_animation_scale 0.0"
+  adb shell "settings put global transition_animation_scale 0.0"
+  adb shell "settings put global animator_duration_scale 0.0"
+}
+
+change_language_if_needed
+sleep 1
+install_google_play
+disable_animation

supervisord.conf

@@ -55,3 +55,10 @@ autorestart=false
 stdout_logfile=%(ENV_LOG_PATH)s/video-recording.stdout.log
 stderr_logfile=%(ENV_LOG_PATH)s/video-recording.stderr.log
 priority=4
+
+[program:adb-utils]
+command=./src/utils.sh
+autorestart=false
+stdout_logfile=%(ENV_LOG_PATH)s/adb-utils.stdout.log
+stderr_logfile=%(ENV_LOG_PATH)s/adb-utils.stderr.log
+priority=5

travis.sh

@@ -9,7 +9,7 @@ else
       echo "Log in to docker hub"
       docker login -u="$DOCKER_USERNAME" -p="$DOCKER_PASSWORD"
       echo "[Version: $ANDROID_VERSION] RUN UNIT TEST, BUILD DOCKER IMAGES AND PUSH THOSE TO DOCKER HUB"
-      bash release.sh all $ANDROID_VERSION all $TRAVIS_TAG
+      bash release.sh all $ANDROID_VERSION $TRAVIS_TAG
     elif [ ! -z "$REAL_DEVICE" ]; then
       echo "[SUPPORT FOR REAL DEVICE: BUILD DOCKER IMAGES AND PUSH THOSE TO DOCKER HUB ]"
       bash release_real.sh all $TRAVIS_TAG