Questions tagged [acceptance-testing]
According to Wikipedia, Acceptance testing is a test conducted to determine if the requirements of a specification or contract are met.
101
questions
2
votes
5
answers
425
views
How to follow Outside-In TDD with Micro-services and Micro-frontends?
I was exploring TDD, specifically the Outside-In TDD pattern, where we need to write the acceptance (integration) test and then jump on to granular unit tests to implement the feature and make the ...
11
votes
4
answers
2k
views
Should you define acceptance tests for vital yet simple behavior?
I'm trying to practice BDD by applying it to a simple problem—in this case, the flocking algorithm, better known as "boids".
Before any of the rules (cohesion, alignment, etc.) comes the ...
- 300
-3
votes
2
answers
325
views
Why are logs not used for testing? [closed]
In tests, state verification or collaboration verification is usually undertaken. One of the drawbacks of this approach is the coupling of tests to the design of constructs. Consequently, when ...
- 342
2
votes
2
answers
527
views
Does the "Pyramid of tests" contradict the idea of tests focusing on behaviour?
I am talking about these two testing strategies :
Have a pyramid of tests (with many more unit tests than high-level tests), because high level tests are harder to maintain and slower (see also : ...
- 207
-3
votes
1
answer
84
views
Registration feature integration testing(Acceptance Testing) [closed]
I would like to add integration testing/automated acceptance testing for a mobile app calling a registration API from the backend. I will register a sample user on the test feature then delete the ...
0
votes
2
answers
451
views
How to reset state of exernal services when running Acceptance tests
What are the generic patterns and best practices for resetting state of a database, storage, external service, etc, in Acceptance Tests?
I'm struggling with spaghetti, living in acceptance tests. It ...
- 111
1
vote
2
answers
78
views
How to use release toggles with Acceptance Test Driven Development?
One of the advantages of feature / release toggles is that you can integrate and deploy code without releasing it. But how does that work with ATDD? If I write some tests that are failing, because I'm ...
- 135
3
votes
1
answer
85
views
Structuring user story tests with variations
I'm writing the sort of tests which go through a whole user scenario e.g.
User clicks "edit profile"
User edits their name
etc.
However, I find myself needing often needing to test small ...
- 1,085
2
votes
1
answer
482
views
Should a large number of system tests be part of the build?
I believe extensive automated unit tests should be part of the build. However the testing pyramid suggests that there should be a much smaller number of system tests.
Should an automatic build include ...
- 155
2
votes
2
answers
218
views
Ease testing with complex setup scenarios
Within our codebase we have integration tests like these:
func TestActivateSuspendedFoo() {
// setup all dependencies
baz := jsonToStruct(
"baz": {
"a": ...
2
votes
3
answers
257
views
Software Quality - preventing regressions with documentation
I lead a small but growing team of developers on an iOS application with a server backend. We have comprehensive unit and integration tests on both ends.
As the product grows, I want the onus of "...
- 139
-3
votes
3
answers
288
views
How to know if I need a unit test? [duplicate]
Do I need unit testing for everything? I know that Unit testing is not necessary for really small tasks, but what about for bigger stuff? How do I know I need a unit test?
-2
votes
2
answers
76
views
How do I model all the different states of a widget for testing?
Say I am a QA person so I have no control over the complexity of the code in the following example.
I have a datatable widget with many different filtering and searching options. All the columns on ...
- 1,145
1
vote
1
answer
233
views
Should BDD/Gherkin be used only for user visible behaviour?
We're a small team of 3 senior and 1 junior developers and I've been tasked with introducing BDD within our development process.
To say there's a lot of confusion about BDD is an understatement and ...
- 1,101
20
votes
7
answers
5k
views
Is it a good idea to write all possible test cases after transforming the team to TDD to achieve a full coverage?
Assume we have a large enterprise-level application without any unit/functional tests. There was no test-driven development process during the development due to very tight deadlines (I know we should ...
2
votes
0
answers
64
views
Where in your pipeline does a company that does X+ of deployments per day deal with running E2E/UA Tests [closed]
The ideal goal for my system is the ability to perform an arbitrary number of deployments per day to production while making sure each 'push' goes through the full test suite to make sure it holds up ...
- 129
-1
votes
3
answers
95
views
How to write user stories for just one acceptance test?
In an interesting Twitter thread, Ron Jeffries (signer of the original Agile Manifesto) is suggesting that all user stories should be broken down so that they have one, and only one, acceptance test.
...
- 3,818
3
votes
2
answers
653
views
Test Internals with TDD?
I'm new to TDD, and relatively new to software development in general (e.g. < 4 years experience), but I am trying to learn.
I have been toying with TDD but ran into what I know realize is a ...
- 1,243
6
votes
3
answers
3k
views
Preferred approach to mock a site to test a scraper
Subj. Atm I'm using Selenium and Python, but the same applies to any other scraping solution.
I'm wondering:
which of the options outlined below are optimal/recommended/best practices
if there are ...
- 593
12
votes
2
answers
678
views
Is software testing different when we are dealing with game development?
I was reading this paper about the differences between software development in general and game development and the authors made some good points regarding software testing, pointing out, for instance,...
- 237
3
votes
3
answers
1k
views
How should I manipulate the database from within an integration test?
I have an integration test that needs to tweak some values on the database. This sort of tweak is not needed for the real application, only to setup the test scenario.
The dilemma:
Should I ...
- 1,273
0
votes
1
answer
191
views
How to prepare test case for System Migration of legacy system while existing functionality is unclear?
I am migrating a legacy system from Oracle Form to Web Application. The migration is conducted with code study and interview.
As the requirement is to migrate the existing system to Web application ...
- 349
8
votes
3
answers
1k
views
Strategy for dealing with A/B tests and Gitflow
I would like to know what strategies do you use to deal with A/B tests of your app and gitflow.
Overview:
We are a team of 6 programmers who develop and maintain a large App. So far we have worked ...
- 188
-1
votes
1
answer
87
views
One suite of tests for different implementations of a protocol
We have a logging protocol that defines how output of logging libraries should look like, e.g.:
each line should be a JSON
each line should not exceed 1MB
There are multiple implementation of this ...
- 650
2
votes
2
answers
414
views
What are techniques to run acceptance tests in a cloud app without polluting the environment with test data?
We are writing a cloud application in a micro-service architecture. We have good unit and integration test coverage for the individual services and we have a set of (public) API level acceptance tests....
- 8,270
1
vote
1
answer
253
views
Best practice to test clustered production system
Say you have a big bloat of enterprise software and for every customer a different setup in terms of amount of appservers, search cluster size, webservers, database, loadbalancers and application-...
- 111
3
votes
3
answers
434
views
Test multiple versions in acceptance
Introduction
I'm working at a software company building software as a service. Currently we have version x.y in production and x.z on acceptance. Let's say we find a critical bug on production and ...
- 133
2
votes
2
answers
206
views
How to publish 2 feature branches on QA?
I have the following scenario:
Joe is working on the feature-xx branch.
Richard is working in another feature-yy branch.
Their company has a qa.myapp.com environment where testers work.
Joe pushes ...
- 21
3
votes
4
answers
953
views
In a testing phase,can I raise a defect which has occured due to deployment issues?
For an example,
In a testing phase if i got a defect which is due to some delayed job restarting,can I raise it as a bug?
In our project,devteam merges and deploy their codes into test site.
usually ...
- 39
3
votes
3
answers
215
views
Do tests that asserts a user can't do an action have any value?
Given a system with static permissions (1 permission for every action that can be made: create a resource, update a resource, etc), and dynamic roles (can be created and assign permissions to it ...
- 2,450
3
votes
2
answers
136
views
How to test a web app (inc write paths) for acceptance or integration tests, without db access?
We are having problems in testing routes that modify the data in our API.
For example the test that deletes a resource will fail if run the second time.
Also due to business logic you can't create ...
- 233
10
votes
3
answers
391
views
Is creating a completely duplicate system for quality assurance (QA) of another a bad practice?
At work we have a quite complicated system. Let's call this system, System_A. Our QA team has created another system, call this system, System_B, to test System_A.
The way System_B is used is as ...
- 539
1
vote
1
answer
263
views
Howto structure my app.js code to make it easier testable
I have a couple of Philip Hue lights in the hallway. These show the build status on their lights with a small Node.JS application. Its working like a charm.
Currently I am in the process of testing ...
5
votes
1
answer
174
views
Acceptance test execution strategies for heavy first-time-setup apps
We have a system with about 250 tables. The first-time-setup include running about 50 queries (known also as seeds).
We're trying out strategies to automatize our acceptance tests, and our first ...
- 2,450
0
votes
1
answer
540
views
Acceptance testing form fields (with Robot Framework)
What is best practice when writing acceptance tests for a form l without knowing the exact layout of the HTML file?
Would it be for example to test that the page contains, let's say an element with ...
- 105
10
votes
4
answers
375
views
Is it a good idea to have separate test methods for every step?
I am testing a REST api. Let's say it returns a JSON structure. What is the best approach to testing the server? Each test step can only succeed if all previous were successful.
Structure A: test ...
- 121
2
votes
4
answers
598
views
How should I manage test data in my functional tests?
I am writing automated functional tests for my application. To interact with the application, I use the SQL database to retrieve data and validate data.
The main challenge that I am facing is ...
3
votes
3
answers
311
views
Shared development and CI database
I'm just about to set up CI for my web application. I'm using Bitbucket and Pipeline beta as a CI. The web application is strongly coupled to the database, nothing can be tested without data in it.
...
- 139
-1
votes
4
answers
857
views
Should a test scenario prepare all of its required data? [closed]
Consider a BDD scenario with some given steps that refer to existence of a set of data in database. For example consider the following scenario steps:
Given there is an active customer
When as and ...
- 109
10
votes
6
answers
4k
views
Acceptance Criteria for Edge Cases
I am a product owner on an agile team. I when doing PO acceptance testing I usually make note to try some edge cases. Its not uncommon for me to discover something and then I pass it back to the the ...
- 211
3
votes
1
answer
348
views
How do you properly test a complete software replacement
We have System A (an application and a database) that is built for a specific business department and therefore has business aligned data model and table structure.
System A is a mission critical ...
- 279
1
vote
1
answer
576
views
Automated test for code that takes a bunch of input data and outputs a bunch of data - should it be split up?
I'm about to write a program and test(s) for it. This question is about how to structure the top-most level integration test.
At the top level, the main program takes a chunk of data, and outputs ...
- 849
2
votes
1
answer
1k
views
Side-by-side Functional and Acceptance Testing (SpecFlow)
Edit: I have found a closely related question: StackOverflow
This question is not about the differences between functional and acceptance tests! Almost all the info I could find on the web just ...
- 123
2
votes
2
answers
735
views
Acceptance testing with preloaded data or filling it on the go
We're figuring out whether we should write acceptance tests that revolves around preloaded data on a database file, or programmatically added needed data per test, or filling database while testing ...
- 2,450
1
vote
0
answers
412
views
Test for PHP Errors using Browser Emulator (Mink)
I want to know the most robust way of checking for PHP error messages when running automated tests that interact with a PHP application via a browser emulator.
The reason is: I use Behat, Mink and ...
- 849
3
votes
3
answers
319
views
Writing your test assertions in your function comments (just before the code)?
I'm using PHP and PHPUnit. Something bothers me: the fact that the assertions are in another class (too easy to forget or to ignore, for any new programmer in the project).
If the test assertions ...
- 147
0
votes
1
answer
2k
views
Problems in QA Environment [duplicate]
At least few times a week I have to track down a bug that would not occur in a production\client environment. 95% of the time I can tell that its a QA configuration\environment problem just by looking ...
- 101
3
votes
1
answer
362
views
GUI functional acceptance tests, making them less brittle / obstacle to further development
(Background - skip to bold statement for the crux)
I'm working through the book "Growing Object-Oriented Software, Guided by Tests" by Freeman & Pryce, while applying it to a project I'm starting....
- 849
1
vote
1
answer
717
views
Behat/Mink: best practice for testing strings in a web application's GUI
I'm writing acceptance tests for a web application using Behat/Mink.
I want to know best practice for testing strings in the GUI. For example: say I want to test that a link exists on the homepage ...
- 849
3
votes
3
answers
4k
views
How do you pass/fail performance tests?
Example:
A certain test is run five times on the current build, to compare it to release 1.0, where the same test was also run five times.
Build 1.4
22 ms, 26 ms, 23 ms, 25 ms, 20 ms
Release 1.0
...
- 145