Skip to main content
The 2024 Developer Survey results are live! See the results

Questions tagged [test-automation]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
-2 votes
2 answers
170 views

Monitor newly released code without real traffic

As new code is released to production, without enough direct access to production execution environments I rely only on user traffic for monitoring. However not all use cases get covered via user ...
sam kirubaharan's user avatar
4 votes
2 answers
192 views

How to check a solution method submitted by a user?

I am developing a website somewhat like leetcode, however, it will be for website testing using Selenium WebDriver.My service will provide different websites, along with various tasks that describe ...
Yahya Abdul Majeed's user avatar
1 vote
1 answer
85 views

How to handle dependencies when writing characterization tests

I am currently working on a codebase that is full of objects that are 3000+ lines long and have at least 20 dependencies each, and I'm about to try covering them with characterization tests before I ...
Nicolas Straub's user avatar
2 votes
1 answer
288 views

How to avoid class-proliferation when creating a unit-testable system?

I've been working on a personal project for some time, and I believe that I'm at that point where, if I don't embrace unit tests (and ideally TDD) now, it may be too late, so I want to make the right ...
Pablo's user avatar
  • 29
-1 votes
2 answers
208 views

Is it a code smell to put selection strategy concerns in an enum class?

Right now, I have this enum, called MemberCategory, defined to be: public enum MemberCategory { MEMBERSHIP("Membership"), GOLD_MEMBERSHIP("Gold"), SILVER_MEMBERSHIP(&...
Mike Warren's user avatar
0 votes
2 answers
270 views

Automated testing: should I check a sub-function was called, or should I check it's result?

I have a big function that does several things, including some database operations, and calling another smaller function. Something like: BigFunction() { DB.SomeTable.AddRow(newRow); ...
MGOwen's user avatar
  • 734
1 vote
2 answers
78 views

How to use release toggles with Acceptance Test Driven Development?

One of the advantages of feature / release toggles is that you can integrate and deploy code without releasing it. But how does that work with ATDD? If I write some tests that are failing, because I'm ...
snowfrogdev's user avatar
3 votes
1 answer
167 views

Is it necessarily a code smell to programmatically create expectation models for test cases?

I'm responsible for staging some tests, against some members, namely against the rates that are due for them. After talking about it with my peers, I see the members are a function of three other ...
Mike Warren's user avatar
20 votes
5 answers
2k views

How to test variable values which differ due to floating point inaccuracy caused by different DBMS types?

I am working on a program that needs to work on floating point values that are fetched from different database types: currently we support 12 different DBMS (for example, two of them are Sqlite3 and ...
Gofrette's user avatar
  • 333
2 votes
1 answer
478 views

Should a large number of system tests be part of the build?

I believe extensive automated unit tests should be part of the build. However the testing pyramid suggests that there should be a much smaller number of system tests. Should an automatic build include ...
Gonen I's user avatar
  • 155
-2 votes
3 answers
165 views

How to identify scope of end-to-end automation testing?

We are struggling in deciding scope of end-to-end tests. As per our understanding, we have automated the form exactly the way users interact with it. below are the steps user perform while submitting ...
ssharma's user avatar
  • 169
1 vote
1 answer
972 views

How to Mock Test Data for complicated Integration/GUI automated tests

General overview We recently had lots of problems with automated tests in our team. Part of it was that the people designated to writing them had little experience. After this failed, we incorporated ...
cah1r's user avatar
  • 302
3 votes
2 answers
1k views

Unit tests vs Automation testing

I'm a C# developer & never worked before on either unit tests or Selenium browser test automation. For a current assignment, there is an existing Visual Studio solution that has a project that ...
sukesh's user avatar
  • 165
2 votes
8 answers
527 views

Should automated testing be specified in software requirements?

When defining software requirements, should automated testing (unit and integration) be specified? I have not seen any guidance on this, and "testing" is not a functional requirement for the software. ...
SoCal's user avatar
  • 159
38 votes
11 answers
12k views

Unexpected Code Coverage Reduction

I am adding unit tests to some existing code which initially was not tested at all. I have set up my CI system to fail builds where the code coverage percentage is reduced compared to previous build -...
Jonathan Gross's user avatar
0 votes
2 answers
885 views

What does automated test pass percentage measure and how is it used in DevOps?

I'm researching DevOps metrics for school. One metric is called "automated test pass percentage." I found one article that says this metric is useful because it is good to know how often code changes ...
Marcus Kim's user avatar
1 vote
2 answers
152 views

In BDD - How do I automate tests up front for things that don't exist YET

My team is just starting with BDD, and we are learning to write scenarios in a GIVEN, WHEN, THEN format. This will position us to start to automate our tests (with selenium) at the start of sprint, ...
EALJAS's user avatar
  • 27
1 vote
1 answer
477 views

Are automated UI tests necessary? What should be tested?

Our small team writes desktop apps using WPF + Prism. Most of the team members are not so familiar with professional software developing process. I'm trying to adopt some agile techniques to make the ...
Aleksei Petrov's user avatar
2 votes
2 answers
3k views

Running automation tests in production

Although many people understand that even if we have the same setup for TEST and UAT environments as we have for PROD, there're still a lot of reasons why it makes sense to run smoke tests in ...
Anuar Nurmakanov's user avatar
8 votes
7 answers
2k views

Rerun unit tests affected by change [closed]

Let's say we have a code base covered with big enough amount of unit tests. We make small change to the code and want to check if tests are still passing. Wouldn't it be great to be able to rerun just ...
Andrew Lanin's user avatar
5 votes
1 answer
557 views

If your company ships multiple products, does it make sense to use a mono repo for your integration tests?

Assumption: Each product codebase is in a separate repo. If the product codebase was a mono repo, it would be a no brainer to just put them together. Assumption: Integration tests in this context ...
Dragan R.'s user avatar
  • 167
0 votes
2 answers
135 views

Using new [className] without a return

I have started using the following in my automation code in instances where I'm not interested in keeping the object 'alive'and just using it as a means as a type of precondition. For example: ...
yorkshireflatcap's user avatar
-2 votes
1 answer
665 views

Auto test with random keys from dict with added values equal to a certain number

I have a list (23 items) of choices and I've transformed it into a dictionary in order to have a value for each choice. I need to select 3 random choices from that dictionary each time I run the test ...
Dan Stefan Craciun's user avatar
2 votes
4 answers
538 views

Automated tests for ‘create user’ functionality, needing unique data

I am writing automated test cases in Visual Studio 2017 test frame work. I am testing the ‘create user’ part of a web API. A user needs to be created with a unique email address. Once a user is ...
Willis White's user avatar
1 vote
1 answer
166 views

By what criteria should automated end-to-end test implementation work be allocated?

Assuming that the entire product team has agreed that implementing some automated end-to-end tests* is worthwhile in the first place... By what criteria should the workload of implementing automated ...
Will's user avatar
  • 712
33 votes
4 answers
14k views

Should I include tests in Docker image?

When it comes to tests, I can think of two options: Put both test and application in one image. Include only application code in the image. Create a test-specific container that builds after the ...
lfk's user avatar
  • 439
3 votes
1 answer
742 views

Where should an on-team QC perform testing in a feature branching scenario?

I have searched and found a few questions talking about testing in relation to feature branching. My question is a little different. We are a scrum* team of 4 to 5 developers with a dedicated on-...
Brian's user avatar
  • 39
3 votes
3 answers
1k views

How should I manipulate the database from within an integration test?

I have an integration test that needs to tweak some values on the database. This sort of tweak is not needed for the real application, only to setup the test scenario. The dilemma: Should I ...
BornToCode's user avatar
  • 1,273
7 votes
3 answers
3k views

How should I write automated tests for an SDK without making live calls to the API?

I've developed an SDK (link) for a RESTful API in PHP, and my automated tests (example) are actually live calls against the API, which is bad for multiple reasons, mainly: it takes a long time (about ...
The Onin's user avatar
  • 179
0 votes
3 answers
346 views

Automating checks for "good" unit tests

There's already a question about How to write good unit tests. Based on the answers provided there, the key properties of a good unit test - Short Readable and conveys intent instantly Independent ...
thegreendroid's user avatar
2 votes
4 answers
4k views

Where to run automation UI Tests - Build server or Test machine

We are having a set of selenium UI tests for our application. We are deploying the application in our test machines in our QA environment. We are using TFS 2015 for continuous integration and ...
Nayana Setty's user avatar
9 votes
6 answers
4k views

Which stage of Agile (SCRUM) should we start creating automation tests?

A little background of me - I'm a manual tester for almost 2 years within an Agile environment using SCRUM (1-2 weeks sprints). So I'm wanting to introduce automation testing in my work using ...
Jay's user avatar
  • 101
0 votes
2 answers
182 views

Which kind of test should I use when dealing with External Endpoints?

My app has a large dependency on external endpoints. As time passes some of them are changing and evolving. Some of these changes are breaking changes... So far i have about 10 dependencies for a ...
Bernardo Campos Coutinho's user avatar
8 votes
2 answers
3k views

Integration tests, but how much?

A recent debate within my team made me wonder. The basic topic is that how much and what shall we cover with functional/integration tests (sure, they are not the same but the example is dummy where it ...
rlegendi's user avatar
  • 191
3 votes
1 answer
747 views

Testing White label iOS and Android mobile apps

We are in the process of developing white label apps for iOS and Android app. I was thinking about the test strategy for handling white label apps with minimum resources. My company is targeting for ...
Rakesh K's user avatar
1 vote
1 answer
52 views

(Mobile automative testing) what exactly should I test for?

I have been writing some automation test scripts for a mobile application. Thus far my tests are very basic, I am struggling to know exactly what to test. An example of a test I have written: Enter ...
Joshua of X's user avatar
3 votes
1 answer
392 views

Functional testing of incomplete features

I've had several tasks where I'm to do functional testing (and to be writing automated test scripts) on features that are not actually complete. For example, CRUD testing on a project to make sure ...
8protons's user avatar
  • 1,369
-1 votes
1 answer
75 views

Is there a benefit to using a specific language with Selenium WebDriver?

As I begin to make the leap from the Firefox Selenium IDE to Selenium 2, I'm realizing that a significant portion of tutorials, guides, books, and documentation regarding WebDriver is based in Java; C#...
8protons's user avatar
  • 1,369
2 votes
1 answer
179 views

How do we design a test approach for inexperienced testers?

We're in the process of shifting our datasource from Mongo to MS SQL Server. Our challenge is that we have two testers who are green. As a team, we're trying to work through the most sensible test ...
Kit Z. Fox's user avatar
5 votes
4 answers
254 views

Can we encourage our test team to collaborate with developers on automating tests?

I am a C# developer, and my team and I are trying to start automated functional tests. (Note that we don't want to do Unit Tests; we expect to develop tests which test one function point per test) ...
Only a Curious Mind's user avatar
5 votes
2 answers
318 views

How do you evaluate automated testing for a particular product/project?

Automated testing is pretty hyped-up in recent years, with particular emphasis on TDD at the "unit" level. The touted advantages include things like: Stabilizing existing code: breaking changes are ...
svidgen's user avatar
  • 15.1k
0 votes
1 answer
605 views

How to write unit tests for an application that mostly performs "hard to test" actions? [duplicate]

In my company we develop medical data-acquisition systems. The main functions of each application are: Interface with data-sampling hardware; Save/load collected data to/from files on disk; Perform ...
heltonbiker's user avatar
  • 1,048
3 votes
1 answer
70 views

How do I manage state better in front-end tests

I write a lot of front-end tests, and the tests fail really often. To be honest, they're hard for me to write. I feel like I have to do a lot of work keeping track of the state of the page. It seems ...
michaelsnowden's user avatar
3 votes
1 answer
430 views

Using parameters in automatic integration tests

I am trying to automate integration testing in our team, and I am wondering if making tests with parameters is good or bad design. My problem is that the integration tests should run some perl ...
Tomáš Šíma's user avatar
2 votes
1 answer
351 views

How do I Create Automated UI test code for application developed using Domain-Driven-Design with very little concrete UI requirements?

We are developing an application using Domain-Driven-Design(DDD). We have to come up with Automated UI Test code. The customer has used 3rd-party GUI Administration template (https://bootstraphunter....
CS Lewis's user avatar
  • 123
-2 votes
1 answer
107 views

Automatically verifying INSERTs when building a PHP(5.3.3) application [closed]

I am building a form in PHP. I would like to automatically verify that INSERT queries are successful, and populate data correctly, as opposed to running queries in Workbench or MySQL with every code ...
nobrandheroes's user avatar
3 votes
3 answers
2k views

How do I test my code in Python other than by doing it by hand?

I am used to user testing in Java, and I also manually test each section of code I write, but now, I want to automate it. There is no GUI for this project, so user testing is not required and I can ...
user1685880's user avatar
5 votes
3 answers
739 views

automated acceptance testing / BDD & workflow for designing a system

Recently, I started reading the book Specification by Example, which relates to automated functional testing and BDD (from what I've understood till now). I've tried using Concordion (.Net), and ...
Karl Cassar's user avatar
30 votes
4 answers
2k views

How to efficiently troubleshoot or test new code when hardware setup to reproduce bugs is difficult or impossible to obtain?

I work at a mid-sized company (150ish employees, ~10 size engineering team), and most of my projects involve interfacing with lab equipment (oscilloscopes, optical spectrum analyzers, etc) for the ...
plast1k's user avatar
  • 1,559
0 votes
3 answers
334 views

How to show to management that unit testing is cheaper in the long run than manual testing? [duplicate]

In the company I work for there is a requirement that all the code should be covered by a test of any kind because they want to have as few user reported defects as possible. With this is mind I ...
Ignacio Soler Garcia's user avatar