GitHub - ja4/sikuli_ruby: JRuby wrapper around sikuli java classes

Sikuli allows you to interact with your application's user interface using image based search to automate user actions.

It's recommended to use JRuby ~> 1.6.0 and run it in 1.9 mode to get unicode characters working as expected.

require 'java'
require 'sikuli'

Sikuli::Config.run do |config|
  config.image_path = "#{Dir.pwd}/images/"
  config.logging = false
end

screen = Sikuli::Screen.new
screen.click(10, 10) # should open your apple menu

app = Sikuli::App.new("iPhone Simulator")
app.window.click('ui_element.png') if app.window.exists?('ui_element.png')