Experitest Data Sheet

Web Testing

Parallel Execution

Increased CoverageDesktop browsers:
Chrome (all versions)
Safari (all versions)
IE (all versions)
Firefox etc…
Supported PlatformsRun your tests in parallel across any number of desktop browsers

Developing and Debugging Web Apps

Interact with your web application on physical devicesNumerous devices
Any OS version
Browser versions
Debug web and hybrid applications directly from the development environmentSafari for Developers
Chrome DevTools
Perform debugging on the device under conditions where errors occurredDevice
Operating system
Configurations
Network setting

Mobile Testing

Manual Testing

Web based interfaceView, control device screens and manually test your application using a web interface, no installation required
Fast device interactionView and control device screens without latency, as if the device is connected locally. With minimal bandwidth requirements
Full device controlSupport all gestures including: Multi-touch, swipe, flick, drag & drop, zoom in and out, scroll including conditional scrolling, shake, pinch, force touch (iOS), tap, and custom generated gestures Full power cycle: Reboot your device, reset or disconnect the USB connection Control all physical and virtual device buttons: Home, volume control, power, recent apps, portrait/landscape mode Send Calls/SMS to the device Quickly switch between different versions of their applications
Test complex use casesTest all the functionality of your applications: Location based feature testing – set any location of a device as necessary for testing (GPS simulation) Test login authentication with TouchID, Password, Pin, Pattern Test audio features such as Siri integration, voice to text, and more Test Image scanning (e.g barcode and check scanning)

Performance Testing

Network VirtualizationSimulate different network profiles (different Bandwidth Latency and Packet Loss)
Simulate different on-the-move scenarios (driving through a tunnel, riding an elevator etc.)
Device vital online monitoringMonitor device and application’s CPU, memory, network and battery
Analyze device resource usage over time

Complex Use Case Testing Capabilities

Location based feature testingTest geolocation-based applications by allowing users to set any location of a device as necessary for testing
Authentication feature testingTest login authentication with TouchID, Password, Pin, Pattern
Audio feature testingTest audio features such as call, voice to text, and more
Trigger incoming SMS/CallsSend Calls/SMS to the device

Non-Functional Testing Capabilities

Device conditionsMonitor different device conditions: device CPU, device memory, device battery consumption including a detailed breakdown of energy consumption causes
Network conditionsSimulate any network condition like server location, user location, network signal, tech parameters bandwidth, jitter, latency, Mobility aspects – user hopping cells, losing reception in tunnel or deteriorated reception in elevator
Run your code on a physical remote deviceNumerous devices
Any OS version
Debug native mobile applications directly from the development environmentXCode, including inserting breakpoints
Android Studio
Perform debugging on the device and conditions where errors occurredDevice
Operating system
Configurations
Network setting

Test Creation

Simple Test Development

Test recorderRecord and play your tests, then automatically export your recorded test to code, use the same test script for different mobile OS
Object spyView your application’s element structure and generate identifiers with ease
XPath querySupport XPath identifiers, along with unique XPath generators and functions
Execution command and element highlightingMark the targeted element of each command with gesture annotations and bounds
Object repository as well as dynamic identificationCreate common objects or descriptively identify your elements in run-time
Offline analysis for element identification failureOpen failed reports within the debug window to identify root causes
Test code generationGenerate test code for all test executions
Advanced object identificationIdentify objects by their properties
Identify customized UI elements
Identify by image or text recognition
Simulators and EmulatorsTest your applications on simulators or emulators

Increased Test Coverage

All app typesTest on native, web and hybrid applications, system & MDM apps (Device settings, SMS verification), and non-packaged apps (Facebook, LinkedIn etc.)
Location-based feature testingTest geolocation-based applications by allowing setting any location of a device as necessary for testing (GPS simulation)
Authentication feature testingTest login authentication with TouchID, Password, Pin, Pattern
Image scanning testingTest image validation stories (e.g barcode and check scanning)
OS supportImmediate support for all General Availability (GA) mobile OS released to the market:
iOS
AndroidSupport for all beta versions of mobile OS within 2 weeks from release to the market

Powerful Test & Automation Development Tools

Dynamic device reflectionProviding immediate visual feedback on all actions
Powerful object identification and managementObject spyIdentify objects by their native/web properties (also image/OCR)
Identify customized UI elements
XPath query
Object repository and dynamic identification
Drag and drop script editor
Appium test capabilities managementAutomatically generated test capability requirements
device, application, version
Verify and analyze scriptsScript “Story” view – visualize the impact of every line of code
Command and element highlighting during test run
Offline analysis for element identification failure
Leverage pre-configured Eclipse project framework assets for mobile includingCode snippets Properties & configuration files

Simple Development & Execution of Robust Tests

Understand application structure and write robust, maintainable tests scriptsObject spy – View your application’s element structure, and generate identifiers with ease
Test recorder – Record and play your tests, then automatically export your recorded test to code
Documentation, videos, free online training
Develop tests using an intuitive user interfaceSee a device reflection
Simple test capabilities management (device, application)
Powerful IDE integration for automation projectsCode export
Automation project boilerplates
Real time visibility of automation run – including execution commands and element highlighting

Test Execution

Integrations

Execute tests in any language, test framework and IDEAny programming language:
Java, C#, Javascript, Perl, Ruby
PythonAny test framework:
Appium, Selenium, XCUITest, Espresso
Any IDE:
Eclipse, IntelliJ
Execute Appium/Selenium/SeeTest mobile testsDevelop and run large Appium/Selenium/Protractor/WebdriverIO automation projects on multiple real iOS and Android devices.
Integrate with Native mobile testing frameworksExecute XCtest & Espresso tests on multiple iOS and Android devices in parallel

Parallel Execution

Increased CoverageRun your tests in parallel across any number of desktop browsers, real mobile devices, simulators, and emulators
Supported PlatformsMobile – iOS (all versions), Android (all versions)
Desktop browsers: Chrome (all versions), Safari (all versions), IE (all versions), Firefox etc…

Execution Management

Leverage Grid intelligent execution managementDynamic test scheduling, execution, and distribution according to specific attributes such as device manufacturer, model, OS version
Mass deployment of app on targeted devices (RESTful API)
Automated provisioning process for apps and services

Continuous Integration

Integrate with any CI EnvironmentIntegrate with:
Jenkins, Bamboo, TeamCity, Hudson

Advanced Grid Capabilities

Grid ViewProvide a grid view of all executions in real-time

Monitoring Capabilities

Network StatisticsRuns your tests under different network conditions
Simulate server & user location, network signal, etc.
Monitor device vitalsMonitors the device vitals during test runs (CPU, memory, battery)

CI/CD Integration & Parallel Execution

Out-of-the-box mobile device grid for large scale executionPre-configured out of the box, no need for additional installation and configuration
Intelligent grid execution managementReal-time view of all executions
Dynamic test scheduling, execution, and distribution. Ability run multiple CI projects in parallel (multiple applications).
Seamless integration into CI environmentsProviding quality status at a glance, reducing environmental noise and highlighting real issues
Quality reporting & analytics and insightImmediate support for all General Availability (GA) mobile OS released to the market:
iOS & Android Support for all beta versions of mobile OS within 2 weeks from release to the market

Test Analytics

Quality Dashboard

Single SnapshotView Key information on all of your applications
Test execution status
Test coverage rate
Root Cause Heat-mapIdentify errors Based on platform, manufacturer, OS, screen size, test, etc.
AlertsTrigger key failure alerts

Test Coverage Analysis


Test Coverage
Define test-coverage matrix dimensions to suit your specific needs
Multi-execution analyticsIdentify gaps in your coverage matrix
Receive trend reports
Execution specific analyticsExecution progress
Compare test execution coverage against baseline for better context

Root-Cause Analysis

Failure GroupingGroup passing tests and omit failures within tolerated levels
Repeat FailuresWeed out repeat failures (e.g. environmental issues, functional aspects, components) and suggest root cause

Failure Correlation Analysis

Application SensitivitiesAutomatically identify sensitive areas in your application (stability, performance, functionality)
Causes of FailureHighlight key factors that cause your test to fail

Eliminate Test Fluctuations

Eliminate Test Fluctuations
Redundant TestsFilter out redundant runs and repetitions
Environmental NoiseDefine rules to reduce environmental noise
Define minimal pass requirements for functional testing (single pass may indicate functional success)
Create thresholds for unstable results
Test GroupingGroup similar test runs for clarity

Eliminate Test Fluctuations

Central ManagementCentrally manage the fault status, including investigation results and action items
Summary ReportsConsolidated management summary reports including fault categorization and resolution
Investigation WorkflowAssign groups of tests to organizational units
Receive updates and feedback
Manage status
Integration with defect management systems
Data SharingEnable data sharing with web access to central test-result repository

Customizable Reports

Focus AreasCreate new reports based on your key focus areas
Report TypesTest status
Coverage reports
Heatmaps
Trend reports – historic analysis of your tests to evaluate progress and identify issues
Reporting ModulePluggable reporting module

Support for all Test Platforms

Testing Frameworks and Defect Management SystemsAll testing frameworks and defect-management systems are supported
Test TypesAll test types supported:
Unit, Smoke, Sanity, Functional, non-functional, UI functional, Persistence, Accessibility
QA ViewEnd-to-end QA view including web, mobile and API

Enterprise Security

Enterprise-Level Security

On-premise set upRetain your company security level, as your devices will reside inside your company’s VPN
Test on an independent physical, and network environment including rack, servers, network equipment,
and devices the racks are Wi-Fi shielded for full network security
Support both TLS and SSL security protocols
Use LDAP information to access the cloud
No USB neededEliminate the need to unlock USB ports in your organization
Physical device securitySecure your device inventory in a datacenter to prevent lost, or missing devices
Malicious software securityPrevent unwanted device upgrades and block the device settings including the Wi-Fi network
ISO SecurityISO 27001 & SOC 2 certified
TLS and SSL protocol support
Multi-factor authentication/Single Sign On (SSO)
Customizable cleanup processes
Access restriction
VPN connections
LDAP integration
OthersEliminate the need for active x or flash, operate in a purely HTML coding environment
Secure user portal
Control access based on role
Create strong passwords with password complexity enforcement, and a password aging policy