Skip to content

Instantly share code, notes, and snippets.

@iegik
Last active November 15, 2023 15:27
Show Gist options
  • Select an option

  • Save iegik/bf48473093ac47ba2627994e426cbf6f to your computer and use it in GitHub Desktop.

Select an option

Save iegik/bf48473093ac47ba2627994e426cbf6f to your computer and use it in GitHub Desktop.

Revisions

  1. iegik revised this gist Nov 15, 2023. 2 changed files with 54 additions and 8 deletions.
    8 changes: 0 additions & 8 deletions REA
    Original file line number Diff line number Diff line change
    @@ -1,8 +0,0 @@
    | Framework | Web | iOS | Android | Language | Pros | Cons |
    | -------------- | --- | --- | ------- | -------- | ---- | ---- |
    | GhostInspector | Y | N | N | Recorded with keywords and export file .side.Selenium IDE can transform the exported file to python | Good variety of UI actions (drag and drop, keypress etc) Ability to select timeout for each testUse spreadsheet to input test cases Modularize test steps in order to not repeat common steps on test cases Set global variables Make assertions while recording Screenshot comparison feature for catching display issuesVideo for every test runChrome extension for test recording API for integration into your CI setup Extract from Javascript in order to store in a variable Notification alerts for test run/suite failures |
    | RobotFramework | Y | Y | Y | Python Java .NET Jython IronPython | RF is application and platform independent User doesn't need a programming language to write a Robot Framework test case & run it Easy with CI/CD Utilizing human-readable keywords/ Keyword Driven Testing Free to use without licensing costsusers can create new higher-level keywords from existing onesFastused for REST and SOAP service tests, database testsParallel Execution using pabotEasy reporting RF Community users are very active in FORUM, STAKE OVERFLOW, google groupsRobot Framework provides lots of libraries to test different application like Appium Libr |
    | Testproject | Y | Y | Y | Python Java |
    | Testcomplete | Y | Y | Y | Javascript Python VBScript |
    | Ranorex | Y | Y | Y | VB.NET C# |
    | LAMBDATEST | Y | Y | Y | Python Java Javascript C-Sharp Ruby PHP |
    54 changes: 54 additions & 0 deletions README.md
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,54 @@
    | Framework | Web | iOS | Android | Language | Integration | Cost per month |
    | -------------- | --- | --- | ------- | -------- | ----------- | -------------- |
    | GhostInspector | Y | N | N | .side.Selenium, python | Azure•GitHub•Jenkins | Already have license |
    | RobotFramework | Y | Y | Y | Python, Java, .NET, Jython, IronPython | Git | Free |
    | Testproject | Y | Y | Y | Python, Java | Jenkins | Free |
    | Testcomplete | Y | Y | Y | Javascript, Python, VBScript | Jira, Azure, Git, Jenkins | Starting at €5,170 |
    | Ranorex | Y | Y | Y | VB.NET, C# | Azure, TestRail, Jenkins | 4790 euro |
    | LAMBDATEST | Y | Y | Y | Python, Java, Javascript, C-Sharp, Ruby, PHP | JenkinsBambooTeamcityGITLAB CIetc.https://www.lambdatest.com/support/docs/integrate-azure-pipelines-with-lambdatest/ | 99 euro per month (billed annually)1 Parallel Test (5 users) |
    | XRay | | | |

    <!--
    **GhostInspector**
    ```diff
    +++Good variety of UI actions (drag and drop, keypress etc) Ability to select timeout for each testUse spreadsheet to input test cases Modularize test steps in order to not repeat common steps on test cases Set global variables Make assertions while recording Screenshot comparison feature for catching display issuesVideo for every test runChrome extension for test recording API for integration into your CI setup Extract from Javascript in order to store in a variable Notification alerts for test run/suite failures
    ---Not able to query database only by using the interface of it e.g. phpMyAdminNot able to import your code into the toolNot able to create tabs and navigate themRecordings relies more on Xpaths than CSS and Xpaths are not optimizedRecor
    ```
    **RobotFramework**
    ```diff
    +++RF is application and platform independent User doesn't need a programming language to write a Robot Framework test case & run it Easy with CI/CD Utilizing human-readable keywords/ Keyword Driven Testing Free to use without licensing costsusers can create new higher-level keywords from existing onesFastused for REST and SOAP service tests, database testsParallel Execution using pabotEasy reporting RF Community users are very active in FORUM, STAKE OVERFLOW, google groupsRobot Framework provides lots of libraries to test different application like Appium Libr
    ---no record and play Less flexibility - No features like author tag, skip test, No nested loops, etcNo integration with Azure
    ```
    **Testproject**
    ```diff
    +++TestProject recorder is a powerful and easy to use record and playback toolTestProject makes sharing tests between team members straightforward and simpleNo coding skills required to get startedShare and reuse addons with your team and the entire communityDetailed report dashboards and analyticsRecording,Execution,Develop,ment and debuggingUse advanced built-in recording capabilities, create and use addons (automation actions shared by the entire community), or develop coded tests using TestProject's powerful SDKSeamlessly integrate with your CI/CD workflow with DevOps popular tools like Jenkins and Slack. Utilize our RESTful API to easily trigger automation, send email notifications and tie into webhooks from other toolsTestProject enhances Appium’s driver and enables you to easily run iOS test automation on Windows operating system, without the need for macOS or Xcode
    ---TestProject needs better support for integration with other products to provide
    ```
    **Testcomplete**
    ```diff
    +++Use the scriptless Record and Replay or keyword-driven tests to easily create automated UI tests.Reusing Automatied Functional TestsFree Training& SupportYou can use record-playback and our keyword-driven framework or script in JavaScript, Python or VBScript. Test Reportin & Analysis
    ---Expensive
    ```
    **Ranorex**
    ```diff
    +++Ranorex Recorder with its drag-and-drop interface allows for conducting script-free tests applying keyword-driven testingReliable object identification, even for web elements with dynamic IDs.Shareable object repository.Reusable code modules to reduce test maintenance.Cross-browser and cross-platform testingTest in parallel or distribute on a Selenium Grid with built-in Selenium WebDriver.Customizable test report.Video reporting of test execution so you can see what happened without re-running a test.Integrates with tools like Jira, Jenkins, TestRail, Git, Travis CI, and more.
    ---Expensive Small CommunityNo run on MACOs Only few supported languages
    ```
    **LAMBDATEST**
    ```diff
    +++3rd Party Integration24x7 supportScreenshot testingExecutte Parallel Testing with Selenium Grid OnlineMobile Testing (Android and Iphone)Debug your Selenium testing results through metadata, network logs, command logs, exception logs, raw Selenium logs, and Video recordings of the entire test execution.Scalability with multiple parallel instances
    ---Doesn’t support native app testing
    ```
    -->
  2. iegik created this gist Nov 15, 2023.
    8 changes: 8 additions & 0 deletions REA
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,8 @@
    | Framework | Web | iOS | Android | Language | Pros | Cons |
    | -------------- | --- | --- | ------- | -------- | ---- | ---- |
    | GhostInspector | Y | N | N | Recorded with keywords and export file .side.Selenium IDE can transform the exported file to python | Good variety of UI actions (drag and drop, keypress etc) Ability to select timeout for each testUse spreadsheet to input test cases Modularize test steps in order to not repeat common steps on test cases Set global variables Make assertions while recording Screenshot comparison feature for catching display issuesVideo for every test runChrome extension for test recording API for integration into your CI setup Extract from Javascript in order to store in a variable Notification alerts for test run/suite failures |
    | RobotFramework | Y | Y | Y | Python Java .NET Jython IronPython | RF is application and platform independent User doesn't need a programming language to write a Robot Framework test case & run it Easy with CI/CD Utilizing human-readable keywords/ Keyword Driven Testing Free to use without licensing costsusers can create new higher-level keywords from existing onesFastused for REST and SOAP service tests, database testsParallel Execution using pabotEasy reporting RF Community users are very active in FORUM, STAKE OVERFLOW, google groupsRobot Framework provides lots of libraries to test different application like Appium Libr |
    | Testproject | Y | Y | Y | Python Java |
    | Testcomplete | Y | Y | Y | Javascript Python VBScript |
    | Ranorex | Y | Y | Y | VB.NET C# |
    | LAMBDATEST | Y | Y | Y | Python Java Javascript C-Sharp Ruby PHP |