Macro Handler

Macro Handler

Android Automation Platform

Object MethodScanning and Detection

Capture.repeatedGlyphRows(left, right)

Measures repeated-character rows against the trailing reference glyph in two Base64 crops. Uses no OCR label or expected count; requires upright, separated printed characters on mostly uniform backgrounds. Mixed or ambiguous rows do not match.

Documented for app version 1.0.57Updated:

Detailed Explanation

This section explains when to use the API, how to call it, and which structures it works best with in production flow.

How To Call It

Capture is a global table: call its functions with a dot (Capture.<method>(...)), not a colon.

When To Use It

In detection flow, refresh the screen with Snap.screenRefresh() first, then narrow the search area and confidence using Region and FindParam.

Parameters and Return

left is the reference Base64 image; right contains target rows. Each image is limited to 950000 Base64 characters and 2000000 pixels. The result contains width, height, referenceWidth, referenceHeight, reference and rows; each row has x, y, w, h, count, score and matched. Coordinates are crop-relative. A score is not an accuracy percentage; do not act on an empty result. Work is bounded to 64 rows, 128 glyphs per row and an approximately two-second budget; invalid input or cancellation raises an error.

Best Combined With

It is typically combined with Snap, Region, Asset, and FindParam; you can feed the result into quickTap(), click(), or a follow-up OCR step.

Example Usage

The snippet below is a starter pattern that can be applied directly in runtime flow.

lua
Try in Editor →
local reference = Capture.regionToBase64(Region(0, 0, 200, 60), "png", 100)
local targets = Capture.regionToBase64(Region(0, 100, 200, 400), "png", 100)
local result = Capture.repeatedGlyphRows(reference, targets)
for _, row in ipairs(result.rows) do
  if row.matched then print(row.count) end
end

Copyable Progressive Examples

From foundation to combined usage, each level is provided as a separate code block so you can copy the level you need and adapt it directly.

Foundation

Shows the shortest direct way to call the API.

Foundation
lua
Try in Editor →
local reference = Capture.regionToBase64(Region(0, 0, 200, 60), "png", 100)
local targets = Capture.regionToBase64(Region(0, 100, 200, 400), "png", 100)
local result = Capture.repeatedGlyphRows(reference, targets)
for _, row in ipairs(result.rows) do
  if row.matched then print(row.count) end
end

Simple

Wraps the base call with minimal flow control.

Simple
lua
Try in Editor →
local stepOk = true
local reference = Capture.regionToBase64(Region(0, 0, 200, 60), "png", 100)
local targets = Capture.regionToBase64(Region(0, 100, 200, 400), "png", 100)
local result = Capture.repeatedGlyphRows(reference, targets)
for _, row in ipairs(result.rows) do
  if row.matched then print(row.count) end
end
if stepOk then
  wait(200)
end

Practical Flow

A practical pattern for real macros with pcall, logging, and guards.

Practical Flow
lua
Try in Editor →
local ok, err = pcall(function()
  local reference = Capture.regionToBase64(Region(0, 0, 200, 60), "png", 100)
  local targets = Capture.regionToBase64(Region(0, 100, 200, 400), "png", 100)
  local result = Capture.repeatedGlyphRows(reference, targets)
  for _, row in ipairs(result.rows) do
    if row.matched then print(row.count) end
  end
end)

if not ok then
  print("API step failed: Capture.repeatedGlyphRows: " .. tostring(err))
  requestStop()
end

Detailed

This level packages the API into a reusable helper with error reporting.

Detailed
lua
Try in Editor →
-- In detection flow, refresh the screen with Snap.screenRefresh() first, then narrow the search area and confidence using Region and FindParam.
local function run_repeatedglyphrows_step()
  local reference = Capture.regionToBase64(Region(0, 0, 200, 60), "png", 100)
  local targets = Capture.regionToBase64(Region(0, 100, 200, 400), "png", 100)
  local result = Capture.repeatedGlyphRows(reference, targets)
  for _, row in ipairs(result.rows) do
    if row.matched then print(row.count) end
  end
end

local ok, err = pcall(run_repeatedglyphrows_step)
if not ok then
  toast("Step failed")
  print(err)
end

Combined

Combines the API with related structures to form a more realistic workflow.

Combined
lua
Try in Editor →
Snap.screenRefresh()
local reference = Capture.regionToBase64(Region(0, 0, 200, 60), "png", 100)
local targets = Capture.regionToBase64(Region(0, 100, 200, 400), "png", 100)
local result = Capture.repeatedGlyphRows(reference, targets)
for _, row in ipairs(result.rows) do
  if row.matched then print(row.count) end
end

local target = Region():find(Asset.image("target"), FindParam.timeout(3000))
if target then
  quickTap(target)
end
toast("Detection step completed")