Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [test-automation]

The tag has no usage guidance.

0
votes
1answer
121 views

Are automated UI tests necessary? What should be tested?

Our small team writes desktop apps using WPF + Prism. Most of the team members are not so familiar with professional software developing process. I'm trying to adopt some agile techniques to make the ...
0
votes
2answers
115 views

Running automation tests in production

Although many people understand that even if we have the same setup for TEST and UAT environments as we have for PROD, there're still a lot of reasons why it makes sense to run smoke tests in ...
4
votes
7answers
201 views

Rerun unit tests affected by change [closed]

Let's say we have a code base covered with big enough amount of unit tests. We make small change to the code and want to check if tests are still passing. Wouldn't it be great to be able to rerun just ...
3
votes
1answer
92 views

If your company ships multiple products, does it make sense to use a mono repo for your integration tests?

Assumption: Each product codebase is in a separate repo. If the product codebase was a mono repo, it would be a no brainer to just put them together. Assumption: Integration tests in this context ...
0
votes
2answers
119 views

Using new [className] without a return

I have started using the following in my automation code in instances where I'm not interested in keeping the object 'alive'and just using it as a means as a type of precondition. For example: ...
-2
votes
1answer
286 views

Auto test with random keys from dict with added values equal to a certain number

I have a list (23 items) of choices and I've transformed it into a dictionary in order to have a value for each choice. I need to select 3 random choices from that dictionary each time I run the test ...
3
votes
4answers
119 views

Automated tests for ‘create user’ functionality, needing unique data

I am writing automated test cases in Visual Studio 2017 test frame work. I am testing the ‘create user’ part of a web API. A user needs to be created with a unique email address. Once a user is ...
1
vote
1answer
126 views

By what criteria should automated end-to-end test implementation work be allocated?

Assuming that the entire product team has agreed that implementing some automated end-to-end tests* is worthwhile in the first place... By what criteria should the workload of implementing automated ...
11
votes
2answers
4k views

Should I include tests in Docker image?

When it comes to tests, I can think of two options: Put both test and application in one image. Include only application code in the image. Create a test-specific container that builds after the ...
3
votes
1answer
394 views

Where should an on-team QC perform testing in a feature branching scenario?

I have searched and found a few questions talking about testing in relation to feature branching. My question is a little different. We are a scrum* team of 4 to 5 developers with a dedicated on-...
2
votes
3answers
267 views

How should I manipulate the database from within an integration test?

I have an integration test that needs to tweak some values on the database. This sort of tweak is not needed for the real application, only to setup the test scenario. The dilemma: Should I ...
6
votes
3answers
995 views

How should I write automated tests for an SDK without making live calls to the API?

I've developed an SDK (link) for a RESTful API in PHP, and my automated tests (example) are actually live calls against the API, which is bad for multiple reasons, mainly: it takes a long time (about ...
0
votes
3answers
314 views

Automating checks for “good” unit tests

There's already a question about How to write good unit tests. Based on the answers provided there, the key properties of a good unit test - Short Readable and conveys intent instantly Independent ...
2
votes
4answers
3k views

Where to run automation UI Tests - Build server or Test machine

We are having a set of selenium UI tests for our application. We are deploying the application in our test machines in our QA environment. We are using TFS 2015 for continuous integration and ...
9
votes
6answers
3k views

Which stage of Agile (SCRUM) should we start creating automation tests?

A little background of me - I'm a manual tester for almost 2 years within an Agile environment using SCRUM (1-2 weeks sprints). So I'm wanting to introduce automation testing in my work using ...
0
votes
2answers
86 views

Which kind of test should I use when dealing with External Endpoints?

My app has a large dependency on external endpoints. As time passes some of them are changing and evolving. Some of these changes are breaking changes... So far i have about 10 dependencies for a ...
8
votes
2answers
1k views

Integration tests, but how much?

A recent debate within my team made me wonder. The basic topic is that how much and what shall we cover with functional/integration tests (sure, they are not the same but the example is dummy where it ...
3
votes
1answer
431 views

Testing White label iOS and Android mobile apps

We are in the process of developing white label apps for iOS and Android app. I was thinking about the test strategy for handling white label apps with minimum resources. My company is targeting for ...
1
vote
1answer
43 views

(Mobile automative testing) what exactly should I test for?

I have been writing some automation test scripts for a mobile application. Thus far my tests are very basic, I am struggling to know exactly what to test. An example of a test I have written: Enter ...
3
votes
1answer
146 views

Functional testing of incomplete features

I've had several tasks where I'm to do functional testing (and to be writing automated test scripts) on features that are not actually complete. For example, CRUD testing on a project to make sure ...
-1
votes
1answer
61 views

Is there a benefit to using a specific language with Selenium WebDriver?

As I begin to make the leap from the Firefox Selenium IDE to Selenium 2, I'm realizing that a significant portion of tutorials, guides, books, and documentation regarding WebDriver is based in Java; C#...
3
votes
1answer
121 views

How do we design a test approach for inexperienced testers?

We're in the process of shifting our datasource from Mongo to MS SQL Server. Our challenge is that we have two testers who are green. As a team, we're trying to work through the most sensible test ...
5
votes
4answers
233 views

Can we encourage our test team to collaborate with developers on automating tests?

I am a C# developer, and my team and I are trying to start automated functional tests. (Note that we don't want to do Unit Tests; we expect to develop tests which test one function point per test) ...
5
votes
2answers
284 views

How do you evaluate automated testing for a particular product/project?

Automated testing is pretty hyped-up in recent years, with particular emphasis on TDD at the "unit" level. The touted advantages include things like: Stabilizing existing code: breaking changes are ...
0
votes
1answer
324 views

How to write unit tests for an application that mostly performs “hard to test” actions? [duplicate]

In my company we develop medical data-acquisition systems. The main functions of each application are: Interface with data-sampling hardware; Save/load collected data to/from files on disk; Perform ...
3
votes
1answer
61 views

How do I manage state better in front-end tests

I write a lot of front-end tests, and the tests fail really often. To be honest, they're hard for me to write. I feel like I have to do a lot of work keeping track of the state of the page. It seems ...
3
votes
1answer
130 views

Using parameters in automatic integration tests

I am trying to automate integration testing in our team, and I am wondering if making tests with parameters is good or bad design. My problem is that the integration tests should run some perl ...
2
votes
1answer
303 views

How do I Create Automated UI test code for application developed using Domain-Driven-Design with very little concrete UI requirements?

We are developing an application using Domain-Driven-Design(DDD). We have to come up with Automated UI Test code. The customer has used 3rd-party GUI Administration template (https://bootstraphunter....
-2
votes
1answer
106 views

Automatically verifying INSERTs when building a PHP(5.3.3) application [closed]

I am building a form in PHP. I would like to automatically verify that INSERT queries are successful, and populate data correctly, as opposed to running queries in Workbench or MySQL with every code ...
3
votes
3answers
1k views

How do I test my code in Python other than by doing it by hand?

I am used to user testing in Java, and I also manually test each section of code I write, but now, I want to automate it. There is no GUI for this project, so user testing is not required and I can ...
5
votes
3answers
586 views

automated acceptance testing / BDD & workflow for designing a system

Recently, I started reading the book Specification by Example, which relates to automated functional testing and BDD (from what I've understood till now). I've tried using Concordion (.Net), and ...
30
votes
4answers
2k views

How to efficiently troubleshoot or test new code when hardware setup to reproduce bugs is difficult or impossible to obtain?

I work at a mid-sized company (150ish employees, ~10 size engineering team), and most of my projects involve interfacing with lab equipment (oscilloscopes, optical spectrum analyzers, etc) for the ...
0
votes
3answers
304 views

How to show to management that unit testing is cheaper in the long run than manual testing? [duplicate]

In the company I work for there is a requirement that all the code should be covered by a test of any kind because they want to have as few user reported defects as possible. With this is mind I ...
-1
votes
3answers
156 views

Potentially shippable product requires automating tests [closed]

To always have a potentially shippable product at the end of each 2-week Sprint, we need to rerun a lot of regression tests at the end of each Sprint. This is very repetitive and time consuming, so ...
2
votes
1answer
139 views

How to test a function that updates the password in database?

I have a test database with few user accounts. I don't want to break any tests. If I am writing a function that updates password for user in db and one that reads the password. Should I ideally reset ...
6
votes
3answers
863 views

Unit (regression) testing scientific algorithms given floating point behavior

I have been working on a project and running into a very difficult problem. The problem can be stated simply as how to unit-test numerical algorithms. However if you just took this simple statement ...
2
votes
1answer
681 views

Automating tests in a browser not supported by selenium

I work on a company that have a payment system that runs under a executable kiosk instance of internet explorer 7. when the application is running the process name is not similar with iexplore.exe or ...
177
votes
16answers
20k views

Why does automated testing keep failing in my company?

We have tried to introduce developer automated testing several times at my company. Our QA team uses Selenium to automate UI tests, but I always wanted to introduce unit tests and integration tests. ...
12
votes
3answers
2k views

What features should be tested via automated UI testing?

We recently had a consultant tell us that if a feature can only be tested via automated UI tests (e.g. Selenium, Coded UI), then there is an underlying architectural issue. While this statement might ...
31
votes
2answers
3k views

How have Guava unit tests been generated automatically?

Guava has unit test cases automatically generated: Guava has staggering numbers of unit tests: as of July 2012, the guava-tests package includes over 286,000 individual test cases. Most of ...
1
vote
3answers
2k views

Test case as a function or test case as a class

I am having a design problem in test automation:- Requirements - Need to test different servers (using unix console and not GUI) through automation framework. Tests which I'm going to run - Unit, ...
1
vote
4answers
184 views

What is the best way to go about testing that we handle failures appropriately?

we're working on error handling in an application. We try to have fairly good automated test coverage. One big problem though is that we don't really know of a way to test some of our error handling. ...
11
votes
9answers
3k views

Copy-and-Pasted Test Code: How Bad is This?

My current job is mostly writing GUI test code for various applications that we work on. However, I find that I tend to copy and paste a lot of code within tests. The reason for this is that the areas ...
14
votes
4answers
4k views

TDD with SQL and data manipulation functions

While I'm a professional programmer, I've never been formally trained in software engineering. As I'm frequently visiting here and SO, I've noticed a trend for writing unit tests whenever possible and,...
3
votes
3answers
2k views

Automation at GUI or API Level in Scrum

I am a Automation Engineer. I use QTP for Automation. I wanted to know couple of things. In a scrum Project which has 2 weeks of work, how can complete automation be done in that time frame (talking ...
17
votes
3answers
3k views

How would you unit-test or perform the most effective automated testing on graphics code for OpenGL?

I'm writing a game and the accompanying graphics engine on top of OpenGL in C++. Im also a fan of good coding processes and automated testing. Graphics code + testing seems pretty immiscible, since ...
1
vote
2answers
8k views

How can I do test automation using a python script to test a c program?

I was wondering if I can use a Python script to test a C program automatically. Suppose I have a very simple C program which reads data (numbers as test cases) from the console, calculates them, then ...
11
votes
3answers
10k views

Can I use Ruby to automate everything?

I face various types of applications (web-based, GUI-based, command-line, etc.) on various platforms (Windows, Linux, etc.) to operate everyday. There is a great opportunity for me to automate tasks ...
48
votes
11answers
32k views

What are the disadvantages of automated testing?

There are a number of questions on this site that give plenty of information about the benefits that can be gained from automated testing. But I didn't see anything that represented the other side of ...
2
votes
1answer
242 views

What is a domain of automatic testing tools such as ScalaCheck?

I've seen not so many examples of testing with automatic tools, i.e. serializing/deserializing of JSON (which was paired in the following way: val actual = deserialize(serialize(string))), checking ...