isaac@isaac: ~/code/appium master
➤ ./bin/test.sh --ios71
RUNNING IOS 7.1 TESTS
---------------------


  common - jsonwp @skip-ci @skip-ios6
    to a non-existent url
      ✓ should get 404 with text/plain body (39ms)
    to get list of sessions
      ✓ should return empty list if no session active
    to a not-yet-implemented url
      ✓ should respond with 501 Not Implemented
    to a variable resource that doesnt exist
      ✓ should respond with a 404
    that generates a server error
      ✓ should respond with a 500
    that generates a server crash
      ✓ should respond with a 500

  common - prelaunch @skip-ci @skip-ios6
    ios @skip-android-all
Expecting Appium to crash.
      ✓ should fail with a nice error message (2266ms)
      ✓ should work for ios (17724ms)
      ✓ should work with force ipad (20075ms)
      ✓ should work with force iphone (18154ms)
      ✓ should work for safari via --safari (20502ms)
      ✓ should work for safari (19157ms)

  settings
    ✓ should return a settings object even if none specified
    ✓ should be able to store a setting
    ✓ should overwrite new settings
    ✓ should leave non-specified settings unchanged

  crash recovery
    ✓ should be able to recover gracefully from an app crash after shutdown (12196ms)

  crash commands
    ✓ should not process new commands until after crash shutdown (1931ms)

  file movements - pullFile and pushFile
    ✓ should not be able to fetch a file from the file system at large
    ✓ should be able to fetch the Address book
    ✓ should not be able to fetch something that does not exist
    ✓ should be able to push and pull a file
    for a .app @skip-ci
      ✓ should be able to fetch a file from the app directory (52ms)
    file movements - pullFolder
      ✓ should pull all the files in Library/AddressBook (232ms)
      ✓ should not pull folders from file system
      ✓ should not be able to fetch a folder that does not exist

  prefs @skip-ios6
    settings app
      ✓ should turn off autocomplete (9812ms)

  prefs @skip-ios6
    settings app with location services
      ✓ should respond to positive locationServicesEnabled cap (8520ms)
    settings app without location services
      ✓ should respond to negative locationServicesEnabled cap (8400ms)

  safari ios7/8 prefs @skip-ci
    using safariIgnoreFraudWarning
      ✓ should respond to cap when true (867ms)
    using safariIgnoreFraudWarning
      ✓ should respond to cap when false (1306ms)

  safari - basics @skip-ios6
    default init
      ✓ it should use appium default init page

  safari - context (ios71) @skip-ios6
    ✓ getting current context should work initially (513ms)

  safari - screenshots @skip-ios6
    default
      ✓ should get an app screenshot (3637ms)
      ✓ should get an app screenshot in landscape mode (10965ms)
    setting screenshotWaitTimeout
      ✓ should get an app screenshot (3009ms)

  touch
    ✓ should flick element (7938ms)

  safari - webview @skip-ios6
    alerts
      ✓ should accept alert (5230ms)
      ✓ should dismiss alert (5356ms)
      ✓ should get text of alert (6631ms)
      ✓ should not get text of alert that closed (6373ms)
      ✓ should set text of prompt (11178ms)
      ✓ should fail to set text of alert @skip-chrome (4503ms)

  safari - webview @skip-ios6
    basics
      ✓ should find a web element in the web view
      ✓ should find multiple web elements in the web view
      ✓ should fail gracefully to find multiple missing web elements in the web view (5151ms)
      ✓ should find element from another element (38ms)
      ✓ should be able to click links (3747ms)
      ✓ should retrieve an element attribute (123ms)
      ✓ should retrieve implicit attributes
      ✓ should retrieve an element text (53ms)
      ✓ should check if two elements are equals (40ms)
      ✓ should return the page source
      ✓ should get current url
      ✓ should send keystrokes to specific element (177ms)
      ✓ should send keystrokes to active element (4044ms)
      ✓ should clear element (297ms)
      ✓ should say whether an input is selected (3578ms)
      ✓ should be able to retrieve css properties (56ms)
      ✓ should retrieve an element size (51ms)
      ✓ should get location of an element (63ms)
      ✓ should retrieve tag name of an element (58ms)
      ✓ should retrieve a window size @skip-chrome
      ✓ should move to an arbitrary x-y element and click on it (3939ms)
      ✓ should submit a form (733ms)
      ✓ should return true when the element is displayed (62ms)
      ✓ should return false when the element is not displayed (52ms)
      ✓ should return true when the element is enabled (42ms)
      ✓ should return false when the element is not enabled (49ms)
      ✓ should return the active element (90ms)
      ✓ should properly navigate to anchor (2032ms)
      ✓ should be able to refresh
skipping: Performance logs aren't available except in Chrome
      ✓ should be able to get performance logs

  safari - webview @skip-ios6
    cookies
      within iframe webview
        ✓ should be able to get cookies for a page with none (7109ms)
      within webview
        ✓ should be able to get cookies for a page
        ✓ should be able to set a cookie for a page (59ms)
        ✓ should be able to set a cookie with expiry (51ms)
        ✓ should be able to delete one cookie (84ms)
        ✓ should be able to delete all cookie (64ms)

  safari - webview @skip-ios6
    executeAsync
      ✓ should bubble up javascript errors (51ms)
      ✓ should execute async javascript
      ✓ should timeout when callback isn't invoked (2030ms)

  safari - webview @skip-ios6
    execute
      ✓ should bubble up javascript errors
      ✓ should eval javascript
      ✓ should not be returning hardcoded results
      ✓ should return nothing when you don't explicitly return
      ✓ should execute code inside the web view
      ✓ should convert selenium element arg to webview element
      ✓ should catch stale or undefined element as arg
      ✓ should be able to return multiple elements from javascript

  safari - webview @skip-ios6
    frames
      ✓ should switch to frame by name (113ms)
      ✓ should switch to frame by index (105ms)
      ✓ should switch to frame by id (91ms)
      ✓ should switch back to default content from frame (101ms)
      ✓ should switch to child frames (169ms)
      ✓ should execute javascript in frame
      ✓ should execute async javascript in frame (104ms)

  safari - webview @skip-ios6
    iframes
      ✓ should switch to iframe by name (72ms)
      ✓ should switch to iframe by index (64ms)
      ✓ should switch to iframe by id (63ms)
      ✓ should switch to iframe by element (169ms)
      ✓ should not switch to iframe by element of wrong type
      ✓ should switch back to default content from iframe (89ms)

  safari - webview @skip-ios6
    implicit wait
      ✓ should set the implicit wait for finding web elements (7316ms)

  safari - webview - special capabilities @skip-ios6
    phishing warning
      ✓ should not display a phishing warning with safariIgnoreFraudWarning @skip-chrome @skip-ios8 (2061ms)
    performance logs
      ✓ should fetch performance logs (125ms)

  safari - webview @skip-ios6
    touch actions
      ✓ should not be able to do native touch actions
      ✓ should not be able to do native multi touch actions (39ms)

  safari - webview @skip-ios6
    window title
      ✓ should return a valid title on web view (39ms)

  safari - windows and frames (ios71) @skip-ios6"
    within webview
      ✓ should throw nosuchwindow if there's not one
      ✓ should be able to open and close windows @skip-ios8 (10533ms)
      ✓ should be able to go back and forward (3444ms)
      ✓ should be able to open js popup windows with safariAllowPopups set to true (4237ms)

  safari - windows and frames (ios71) @skip-ios6 - without safariAllowPopups
    ✓ should not be able to open js popup windows with safariAllowPopups set to false (7749ms)

  testapp - active
    ✓ should return active element (1121ms)

  testapp - autoAcceptAlerts cap = ""
    ✓ does not auto-accept alerts (5235ms)

  testapp - autoAcceptAlerts cap = false
    ✓ does not auto-accept alerts (5362ms)

  testapp - autoAcceptAlerts cap = "false"
    ✓ does not auto-accept alerts (5222ms)

  testapp - autoAcceptAlerts cap = true
    ✓ auto-accepts alerts (5329ms)

  testapp - autoAcceptAlerts cap = "true"
    ✓ auto-accepts alerts (5269ms)

  testapp - autoDismissAlerts cap = ""
    ✓ does not auto-dismiss alerts (5229ms)

  testapp - autoDismissAlerts cap = false
    ✓ does not auto-dismiss alerts (5224ms)

  testapp - autoDismissAlerts cap = "false"
    ✓ does not auto-dismiss alerts (5221ms)

  testapp - autoDismissAlerts cap = true
    ✓ auto-dismiss alerts (5083ms)

  testapp - autoDismissAlerts cap = "true"
    ✓ auto-dismiss alerts (5304ms)

  testapp - basics - calc app 1
    ✓ should fill two fields with numbers (9430ms)
    ✓ should fill two fields with numbers - sendKeys (10765ms)
    ✓ should fill two fields with numbers - setValue (7887ms)
    ✓ should confirm that button is displayed (2027ms)
    ✓ should confirm that the disabled button is disabled (2047ms)
    ✓ should confirm that the compute sum button is enabled (2045ms)
    ✓ should interact with alert (8523ms)
    ✓ should find alert like other elements (8339ms)
    ✓ should get tag names of elements (4060ms)
    ✓ should be able to get text of a button (1997ms)

  testapp - basics - calc app 2
    ✓ should lookup two fields by name and populate them with random numbers to finally sum them up (12631ms)
    ✓ should receive correct error
    ✓ should be able to get syslog log type
    ✓ should be able to get syslog logs @skip-ios6 @skip-ios8 @skip-ci (4308ms)
    ✓ should be able to get crashlog logs @skip-ci (136ms)

  testapp - clear
    ✓ should clear the text field (10802ms)
    ✓ should hide keyboard using "Done" key (8448ms)
    ✓ should hide keyboard using "pressKey" strategy with "Done" key (9266ms)
    ✓ should hide keyboard using "pressKey" strategy with "Done" keyName (9210ms)
    ✓ should hide keyboard using "press" strategy with "Done" key (9467ms)
    - should hide keyboard using "swipeDown" strategy

  testapp - context methods
    ✓ getting list multiple times should not crash appium (74138ms)
    ✓ setting context to 'null' should work (10576ms)
    ✓ setting context to 'NATIVE_APP' should work (10653ms)
    ✓ setting context to non-existent context should return 'NoSuchContext' (status: 35)

  testapp - device
    xcode#getpath
      ✓ should always return a valid path
ERR! xcode-select could not find xcode. Path: /foo/bar does not exist.
WARN Finding XcodePath by symlink because Error: xcode-select could not find xcode. Path: /foo/bar does not exist.
WARN Could not find path to Xcode, environment variable DEVELOPER_DIR set to: /foo/bar but no Xcode found
      ✓ should fail with a bad path (45ms)
    invalid deviceName @skip-ios6
      ✓ should fail gracefully with an invalid deviceName (814ms)
    generic iPhone deviceName @skip-ios6
      ✓ should work with a generic iPhone deviceName (14104ms)
    generic iPad deviceName @skip-ios6
      ✓ should work with a generic iPad deviceName (16821ms)
    real device
      ✓ shouldn't try to validate against sims (247ms)

  testapp - find element
    ✓ should find a single element on the app (1014ms)
    ✓ should not find any invalid elements on the app and throw error (5050ms)
    ✓ should find alerts when they exist (7068ms)
    ✓ should not find alerts when they dont exist (5102ms)
    ✓ should get an error when strategy doesnt exist
    ✓ should find all elements by class name in the app (1002ms)
    ✓ should not find any elements on the app but fail gracefully (5018ms)
    ✓ should find element by valid name (1019ms)
    ✓ should not find element by invalid name but return respective error code (5129ms)
    ✓ should find an element with accessibility id containing an apostrophe (1026ms)
    ✓ should not find element by incomplete class name but return respective error code
    ✓ should find multiple elements by valid name (998ms)
    by id
      ✓ should first attempt to match accessibility id (2057ms)
      ✓ should attempt to match by string if no accessibility id matches (2012ms)
      ✓ should use a localized string if the id is a localization key (3120ms)
      ✓ should be able to return multiple matches (2117ms)

  testapp - get attribute
    ✓ should get element attribute (2048ms)

  testapp - keyboard
    typing with strategy:undefined
      ✓ should send keys to a text field (11024ms)
    typing with strategy:oneByOne
      ✓ should send keys to a text field (10902ms)
    typing with strategy:grouped
      ✓ should send keys to a text field (9767ms)
    typing with strategy:setValue
      ✓ should send keys to a text field (8024ms)
    typing
      ✓ should send accented text (4889ms)
      ✓ should send backspace key (6705ms)
      ✓ should send delete key (7137ms)
      stability @skip-ci
        sendKeys test 1
          ✓ should send keys to a text field (19795ms)
        sendKeys test 2
          ✓ should send keys to a text field (19404ms)
        sendKeys test 3
          ✓ should send keys to a text field (19501ms)
        sendKeys test 4
          ✓ should send keys to a text field (19399ms)
        sendKeys test 5
          ✓ should send keys to a text field (19444ms)
        sendKeys test 6
          ✓ should send keys to a text field (19421ms)
        sendKeys test 7
          ✓ should send keys to a text field (19448ms)
        sendKeys test 8
          ✓ should send keys to a text field (19685ms)
        sendKeys test 9
          ✓ should send keys to a text field (19493ms)
        sendKeys test 10
          ✓ should send keys to a text field (19380ms)

  localization - calendarFormat @skip-ios8
    changing to gregorian calendar
      ✓ should have gregorian calendar format (1013ms)
    changing to buddhist calendar
      ✓ should have buddhist calendar format (996ms)

  localization - language @skip-ios8
    changing to fr
      ✓ should be fr (1028ms)
    changing to de
      ✓ should be de (961ms)

  localization - locale
    default locale
      ✓ should be english @skip-ios8 (968ms)
    changing locale
      ✓ should be fr (995ms)
    changing back
      ✓ should be en (1012ms)

  testapp - location - 1 @skip-ci
    ✓ should return the right x/y coordinates (1981ms)
    ✓ should not error with valid lat/lon and no options (1001ms)
    ✓ should error with invalid lat/lon and no options (1084ms)

  testapp - location - 2 @skip-ci
    ✓ should be able to be turned on (2022ms)

  testapp - location - 3 @skip-ci
    ✓ should not work without bundleId (45ms)

  testapp - location - 4 @skip-ci
    ✓ should be able to be turned off (2012ms)

  testapp - location - 5 @skip-ci
    ✓ should be able to be turned on when using a zip/ipa file (1983ms)

  testapp - pinchOpen/pinchClose
    ✓ should pinchOpen and pinchClose map after tapping Test Gesture (23522ms)

  testapp - rotation gesture
    ✓ should rotate map after tapping Test Gesture (14467ms)

  testapp - sessions
    ✓ should return appear in the sessions returned @skip-ci

  testapp - simple
    using calc app
      ✓ should fill two fields with numbers (9431ms)

  testapp - size
    element size
      ✓ should return the right element size (2025ms)
      ✓ should return the window size (1013ms)

  testapp - source
    ✓ should return page source (1058ms)

  testapp - timeout
    implicit wait
      ✓ should set the implicit wait for finding elements (12331ms)
      ✓ should work with small command timeout (10140ms)
      ✓ should work even with a reset in the middle (26591ms)

  testapp - timeout
    mobile reset
      ✓ should die with short command timeout even after mobile reset (31217ms)

  testapp - timeout
    short timeout
      ✓ should die with short command timeout (5526ms)

  testapp - timeout
    via desired caps
      ✓ should die with short command timeout (5511ms)

  testapp - timeout
    zero timeout
      ✓ when set to 0 should disable itself (4004ms)

  testapp - touch actions
    tap
      ✓ should tap on a specified element (13279ms)
    wait
      ✓ should move the page and wait a bit (21466ms)
    pinch
      ✓ should do some pinching (9570ms)
      ✓ should do more involved pinching in and out (14968ms)

  testapp - swipe actions
    swipe
      ✓ should work with: press {element}, moveTo {destEl} (5713ms)
      ✓ should work with: press {element, x, y}, moveTo {element, x, y} (5724ms)
      ✓ should work with: press {x, y}, moveTo {x, y} (2617ms)
      ✓ should work with: {element, x, y}, moveTo {destEl, x, y} (5726ms)
      ✓ should work with press {x, y}, moveTo {destEl} (4664ms)

  testapp - wait-for-apps
    just waiting
      ✓ should work (2102ms)
    waiting for one element
      ✓ should work (2040ms)
    bad script
      ✓ should work (992ms)

  uicatalog - alerts @skip-ios6
    ✓ should detect Simple (11614ms)
    ✓ should detect Okay (11532ms)
    ✓ should detect Other (11558ms)

  uicatalog - background app @skip-ios6
    ✓ should background the app for 4 of seconds (+/- 6 secs) (7713ms)

  uicatalog - basic @skip-ios6
    api
      ✓ should confirm element is not visible (6518ms)
      ✓ should confirm element is visible (5418ms)
      ✓ should confirm element is selected (6398ms)
      ✓ should confirm element is not selected returns false (7578ms)
    appium ios @skip-ci
      ✓ should go back to using app from before (986ms)

  uicatalog - clear @skip-ios6
    hide keyboard
      ✓ should be able to hide keyboard with the default strategy (19511ms)
      ✓ should be able to hide keyboard with the tapOutside strategy (18167ms)
      ✓ should be able to hide keyboard with the tapOut strategy (18083ms)

  uicatalog - controls @skip-ios6
    ✓ should be able to get and set a picker value(s) (37801ms)
    ✓ should be able to get and set a slider value (7801ms)

  uicatalog - execute @skip-ios6
    ✓ should do UIAutomation commands if not in web frame (977ms)
    ✓ should not fail if UIAutomation command blows up (1161ms)
    ✓ should not fail with quotes (982ms)

  uicatalog - find - basics @skip-ios6
    ✓ should find a single element by id (2257ms)
    ✓ should find a single element by id wrapped in array for multi (1115ms)
    ✓ should find a single element using elementByAccessibilityId (1012ms)
    ✓ should find an element within descendants (4212ms)
    ✓ should not find an element not within itself (7126ms)
    ✓ should find some elements within itself (3151ms)
    ✓ should not find elements not within itself (2150ms)
    ✓ should return all image elements with internally generated ids (2006ms)
    no mix up
      ✓ should not allow found elements to be mixed up (11354ms)
    findElementsByClassName textfield case
      ✓ should find only one textfield (4214ms)
    findElement(s) containing accessibility id
      ✓ should find one element (4079ms)
      ✓ should find several elements (3239ms)
    duplicate text field
      ✓ should find only one element per text field (6308ms)
      ✓ should find only one element per secure text field (5243ms)

  uicatalog - find by accessibility id @skip-ios6
    ✓ should find an element by name beneath another element (3232ms)

  uicatalog - find by ios-ui-automation @skip-ios6
    ✓ should process most basic UIAutomation query (3517ms)
    ✓ should use raw selector code if selector doesn't start with a dot (4045ms)
    ✓ should get a single element (2022ms)
    ✓ should get a single element with non-zero index (2037ms)
    ✓ should get single element as array (1030ms)
    ✓ should find elements by index multiple times (2013ms)
    ✓ should find elements by name (2030ms)
    ✓ should find elements by type and index (2024ms)
    start from a given context instead of root target
      ✓ should process a simple query (2065ms)
      ✓ should find elements by name (2024ms)

  uicatalog - find by xpath @skip-ios6
    individual calls
      ✓ should return the last button (6790ms)
      ✓ should return a single element (6082ms)
      ✓ should return multiple elements (5697ms)
      ✓ should filter by name (6470ms)
      ✓ should know how to restrict root-level elements (8889ms)
      ✓ should search an extended path by child (6674ms)
      ✓ should search an extended path by descendant (10511ms)
      ✓ should filter by indices (7491ms)
      ✓ should filter by partial text (6521ms)
      duplicate text field
        ✓ should find only one text field (6414ms)
        ✓ should find only one text field when doing relative search (8759ms)
        ✓ should find only one secure text field (6349ms)
    multiple calls
      finding specific path
        test 1
          ✓ should not crash (2297ms)
        test 2
          ✓ should not crash (2522ms)
        test 3
          ✓ should not crash (2413ms)
        test 4
          ✓ should not crash (2737ms)
        test 5
          ✓ should not crash (2346ms)
      finding //*
        test 1
          ✓ should not crash (2620ms)
        test 2
          ✓ should not crash (2663ms)
        test 3
          ✓ should not crash (2750ms)
        test 4
          ✓ should not crash (2691ms)
        test 5
          ✓ should not crash (2644ms)

  uicatalog - gestures - complex tap @skip-ios6
    ✓ should work with custom options (5452ms)
    ✓ should work in relative units (5428ms)
    ✓ should work with default options (3467ms)
    with element
      ✓ should work in relative units (5596ms)
      ✓ should work in pixels (5472ms)

  uicatalog - gestures - mobile scroll @skip-ios6
    ✓ should scroll down and up (6136ms)
    ✓ should scroll down and up using element (7090ms)

  uicatalog - gestures - mobile shake @skip-ios6
    ✓ should not error (1001ms)

  uicatalog - load app with absolute path @skip-ios6
    ✓ should load with absolute path (1018ms)

  uicatalog - load zipped app @skip-ios6
    ✓ should load a zipped app via path (1024ms)

  uicatalog - load app with relative path @skip-ios6
    ✓ should load with relative path (960ms)

  uicatalog - load zipped app with relative path @skip-ios6
    ✓ should load a zipped app via path (1303ms)

  uicatalog - load zipped app via url @skip-ios6
    ✓ should load a zipped app via url (1009ms)

  uicatalog - lock device @skip-ios6
    ✓ should lock the device for 4 seconds (+/- 9  secs) (7659ms)

  uicatalog - move @skip-ios6
    moveTo and click
      ✓ should be able to click on arbitrary x-y elements (5616ms)

  uicatalog - reset @skip-ios6
    app reset
      ✓ should be able to find elements after a soft reset (22048ms)
      ✓ should successfully close an app (22839ms)

  uicatalog - touch @skip-ios6
    ✓ should tap element with count (9437ms)
    ✓ should tap element with offset and count (8800ms)
    ✓ should tap offset with count (11070ms)

  uicatalog - contexts @skip-ios6
    ✓ getting contexts should do nothing when no webview open (616ms)

  webview - basics
    ✓ getting current context should return NATIVE_APP when none set
    ✓ getting list should work after webview open (67ms)
    ✓ getting list multiple times should not crash appium (141ms)
    ✓ contexts should be strings
    ✓ setting context to 'WEBVIEW_1' should work (3109ms)
    ✓ setting context to 'WEBVIEW_1' should work without first getting contexts (3090ms)
    ✓ setting context to 'WEBVIEW' should work (3056ms)
    ✓ setting context to 'null' should work
    ✓ returning to 'NATIVE_APP' should work (53ms)
    ✓ setting context to non-existent context should return 'NoSuchContext' (status: 35)
    ✓ switching back and forth between native and webview contexts should work @skip-ios6 (10371ms)

  webview - orientation
    ✓ should get and set - LANDSCAPE (3014ms)
    ✓ should get and set - PORTRAIT (2989ms)

  webview - auto
    ✓ should go directly into webview (2204ms)


  328 passing (1h)
  1 pending

     4414.51 real        38.81 user         5.78 sys
isaac@isaac: ~/code/appium master
➤