Scrcpy mask - Realize simulator like smooth mobile gaming experience through 'key mapping': cross platform PC controlled Android tool

Scrcpy-mask Is based on Scrcpy Graphical interface tool, cross platform. It supports visual mapping of mouse and keyboard keys, and can play mobile games on the computer smoothly. Support Windows, macOS (support M-chip), Linux@ Appinn

Scrcpy mask - Realize simulative smooth mobile gaming experience through 'key mapping': cross platform PC controlled Android tool

What is Scrcpy

Scrcpy It is still Scrcpy, an open source project with 100000+GitHub stars, whose main function is to display and control your Android device.

There are many projects based on Scrcpy. Our label There are many introductions in. Scrcpy mask is also such a model.

come from Discovery Channel , Developer@ ruchuby Self recommendation: https://meta.appinn.net/t/topic/56349

I'm playing the ace on the Mac: Scrcpy Mask, an open source project, controls Android devices with a mouse and keyboard like a simulator, and is a cross platform client developed based on Rust&Tarui

In order to realize computer control of Android devices, I (@ ruchuby ）Developed a cross platform desktop client using Tarui+Vue 3+Rust. The client can provide visual mouse and keyboard key mapping configuration. Multi touch operation similar to Android simulator is realized through key mapping, with millisecond response speed. This tool can be widely used for computer controlled Android devices to play mobile games and so on, providing a smooth touch experience.

This project only implements the Scrcpy control protocol, No screen projection function 。 Because there will be delays and blurring problems in screen projection, this project will find another way to give up screen projection directly, and use transparent mask to display the content behind the window (you can use AVD, the mobile phone has its own low delay screen projection interface, etc.), fundamentally eliminating the phenomenon of screen projection delay.

Visual editing key mapping configuration

Scrcpy mask - Realize simulative smooth mobile gaming experience through 'key mapping': cross platform computer control Android tool 1

Features&TODO

✅ Wired and wireless connection to Android devices
✅ Start and connect to the Scrcpy server
✅ Implement Scrcpy control protocol
✅ Mouse and keyboard key mapping
✅ Visual editing key mapping configuration
✅ Import and export of key mapping configuration
✅ Update Check
✅ Switch between key mapping and inserting text
✅ internationalization
Handle key mapping
Better macros
Provide external interface through WebSocket
Help Documents

Small video

The developer also recorded a video:

Basic use

install
Confirm your Android device type
1. For physical devices such as mobile phones or tablets
  1. You need to solve the problem of screen projection. It is recommended to use the official screen projection mode of the device brand, which generally has the smallest delay.
  2. Enable ADB debugging on the device via USB or wireless, and then connect it to the computer.
2. For the simulator, screen projection is not required, and ADB wired debugging is usually enabled by default. So you can get the best experience with almost no operation.
Start the software and navigate to the device page.
1. Find your device in the available devices (if not, please search for how to enable ADB debugging for the installation device).
2. Right click your device and select Get Screen Size. Enter the width and height of the device correctly according to the screen size obtained as a reference. Note: If the width or height is incorrect (for example, the two parameters are reversed in portrait and landscape modes), all touch operations will be ignored, but there will be no error message.
3. Right click the device again and select "Control this device".
Navigate to the settings page ->mask settings, and set the mask width and height to a certain multiple of the device size to ensure that the mask size is appropriate.
Navigate to the mask page, where you can see a completely transparent mask area. Next, adjust and move the simulator window or projection window so that its content area is perfectly aligned with the transparent mask area.
Navigate to the key mapping page to switch or edit the key mapping configuration.
Return to the mask interface and start using it!