我在一个类似于Team View QuickSupport的项目中工作,我想知道AccessibilityService
是否允许在远程屏幕上执行滑动,以便能够绘制保护设备的密码?
我来尝试以下代码,但没有成功。到目前为止,所有发生的事情都是android代码上的异常,它说:
java.lang.IllegalStateException:尝试向手势添加过多笔划
这里:
gestureBuilder.addStroke(new GestureDescription.StrokeDescription(path, 0, time));
当前的Java代码是这样的:
if (xline.contains("mouseswipescreen")) {
String coords = xline.replace("mouseswipescreen", "");
String[] tokens = coords.split(Pattern.quote("<|>"));
float x = parseFloat(tokens[0]);
float y = parseFloat(tokens[1]);
String cmd = tokens[2];
MyAccessibility.instance.Swipte((int) x, (int) y, 50, cmd);
}
GestureDescription.Builder gestureBuilder;
Path path;
public void Swipte(int x, int y, int time, String command) {
if (android.os.Build.VERSION.SDK_INT >= android.os.Build.VERSION_CODES.N) {
System.out.println(" ======= Swipte =======");
if (command.equalsIgnoreCase("start")) {
gestureBuilder = new GestureDescription.Builder();
path = new Path();
path.moveTo(x, y);
} else if (command.equalsIgnoreCase("move")) {
path.lineTo(x, y);
gestureBuilder.addStroke(new GestureDescription.StrokeDescription(path, 0, time));
} else if (command.equalsIgnoreCase("dispatch")) {
dispatchGesture(gestureBuilder.build(), new GestureResultCallback() {
@Override
public void onCompleted(GestureDescription gestureDescription) {
System.out.println("SWIPTE Gesture Completed :D");
super.onCompleted(gestureDescription);
}
}, null);
}
}
}
现在更改此代码以执行保持这种方式的滑动屏幕:
public void Swipte(int x1, int y1, int x2, int y2, int time){
if (android.os.Build.VERSION.SDK_INT >= android.os.Build.VERSION_CODES.N) {
System.out.println(" ======= Swipte =======");
GestureDescription.Builder gestureBuilder = new GestureDescription.Builder();
Path path = new Path();
path.moveTo(x1,y1); // "mousedown"
path.lineTo(x2,y2); // until last position found in "mousemove"
gestureBuilder.addStroke(new GestureDescription.StrokeDescription(path, 0, time));
dispatchGesture(gestureBuilder.build(), new GestureResultCallback() {
@Override
public void onCompleted(GestureDescription gestureDescription) {
System.out.println("SWIPTE Gesture Completed :D");
super.onCompleted(gestureDescription);
}
}, null);
}
}
结果是这样的:
看到这是一个错误的密码。
最后是代码(Delphi),它基于上面的第一个Java代码发送坐标(qazxsw poi):
reference
好吧,我回答我自己的问题,已经是 private
{ Private declarations }
fDown: Boolean;
fPO: TPoint;
public
{ Public declarations }
end;
...
procedure TForm2.Image1MouseDown(Sender: TObject; Button: TMouseButton;
Shift: TShiftState; X, Y: Integer);
var
Index, XTouch, YTouch, RXCoord, RYCoord: Integer;
List: TStrings;
RScreen, Start: String;
begin
Index := Form1.ListView1.ItemIndex;
if Index = -1 then
Exit;
List := TStringList.Create;
RScreen := Form1.ListView1.Selected.SubItems[6]; // Remote screen resolution
try
ExtractStrings(['x'], [], PChar(RScreen), List); // Ex: my smartphone is 1920x1080
RYCoord := StrToInt(List[0]); // 1920 (height)
RXCoord := StrToInt(List[1]); // 1080 (width)
finally
List.Free;
end;
XTouch := Round((X / Image1.Width) * RXCoord);
YTouch := Round((Y / Image1.Height) * RYCoord);
fPO := Point(XTouch, YTouch);
Start := 'start';
fDown := true;
Form1.ServerSocket1.Socket.Connections[Index].SendText(format('mouseswipescreen%d<|>%d<|>%s'#13#10, [fPO.X, fPO.Y, Start]));
end;
end;
procedure TForm2.Image1MouseMove(Sender: TObject; Shift: TShiftState;
X, Y: Integer);
var
Index, XTouch, YTouch, RXCoord, RYCoord: Integer;
List: TStrings;
RScreen, Move: String;
begin
Index := Form1.ListView1.ItemIndex;
if Index = -1 then
Exit;
List := TStringList.Create;
RScreen := Form1.ListView1.Selected.SubItems[6]; // Remote screen resolution
try
ExtractStrings(['x'], [], PChar(RScreen), List); // Ex: my smartphone is 1920x1080
RYCoord := StrToInt(List[0]); // 1920 (height)
RXCoord := StrToInt(List[1]); // 1080 (width)
finally
List.Free;
end;
XTouch := Round((X / Image1.Width) * RXCoord);
YTouch := Round((Y / Image1.Height) * RYCoord);
if fDown then
begin
Move := 'move';
Form1.ServerSocket1.Socket.Connections[Index].SendText(format('mouseswipescreen%d<|>%d<|>%s'#13#10, [fPO.X, fPO.Y, Move]));
fPO := Point(XTouch, YTouch);
end;
end;
procedure TForm2.Image1MouseUp(Sender: TObject; Button: TMouseButton;
Shift: TShiftState; X, Y: Integer);
begin
if fDown then
fDown := false;
end;
的专家认为我正在构建恶意软件而不是帮助这些人。
回答:
我的方法是正确的,不幸的是,直到这一刻看到,不可能使用AccessibilityService
实现这个目标,因为存在AccessibilityService
,limitation on storage of gestures是官方参考:
here
而且,直到现在(在这种情况下)当执行2个快速鼠标点击并且发送时,addStroke(new GestureDescription.StrokeDescription(path, 0, time));
无法在某些点(构成密码屏幕的9个点)执行触摸“仅按下并且不松动”的手势:
AccessibilityService
在开始之前和绘制密码期间(拖动鼠标),仅在完全绘制密码时释放,并且:
procedure TForm2.Image1MouseDown(Sender: TObject; Button: TMouseButton;
Shift: TShiftState; X, Y: Integer);
被发送到远程设备。
编辑:
注意:procedure TForm2.Image1MouseUp(Sender: TObject; Button: TMouseButton;
Shift: TShiftState; X, Y: Integer);
能够这样做因为使用Team View QuickSupport。