Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [acceptance-testing]

According to Wikipedia, Acceptance testing is a test conducted to determine if the requirements of a specification or contract are met.

0
votes
1answer
61 views

Should BDD/Gherkin be used only for user visible behaviour?

We're a small team of 3 senior and 1 junior developers and I've been tasked with introducing BDD within our development process. To say there's a lot of confusion about BDD is an understatement and ...
16
votes
7answers
4k views

Is it a good idea to write all possible test cases after transforming the team to TDD to achieve a full coverage?

Assume we have a large enterprise-level application without any unit/functional tests. There was no test-driven development process during the development due to very tight deadlines (I know we should ...
2
votes
0answers
48 views

Where in your pipeline does a company that does X+ of deployments per day deal with running E2E/UA Tests [closed]

The ideal goal for my system is the ability to perform an arbitrary number of deployments per day to production while making sure each 'push' goes through the full test suite to make sure it holds up ...
-1
votes
3answers
68 views

How to write user stories for just one acceptance test?

In an interesting Twitter thread, Ron Jeffries (signer of the original Agile Manifesto) is suggesting that all user stories should be broken down so that they have one, and only one, acceptance test. ...
3
votes
2answers
220 views

Test Internals with TDD?

I'm new to TDD, and relatively new to software development in general (e.g. < 4 years experience), but I am trying to learn. I have been toying with TDD but ran into what I know realize is a ...
3
votes
3answers
397 views

Preferred approach to mock a site to test a scraper

Subj. Atm I'm using Selenium and Python, but the same applies to any other scraping solution. I'm wondering: which of the options outlined below are optimal/recommended/best practices if there are ...
11
votes
2answers
608 views

Is software testing different when we are dealing with game development?

I was reading this paper about the differences between software development in general and game development and the authors made some good points regarding software testing, pointing out, for instance,...
2
votes
3answers
244 views

How should I manipulate the database from within an integration test?

I have an integration test that needs to tweak some values on the database. This sort of tweak is not needed for the real application, only to setup the test scenario. The dilemma: Should I ...
0
votes
1answer
111 views

How to prepare test case for System Migration of legacy system while existing functionality is unclear?

I am migrating a legacy system from Oracle Form to Web Application. The migration is conducted with code study and interview. As the requirement is to migrate the existing system to Web application ...
8
votes
3answers
338 views

Strategy for dealing with A/B tests and Gitflow

I would like to know what strategies do you use to deal with A/B tests of your app and gitflow. Overview: We are a team of 6 programmers who develop and maintain a large App. So far we have worked ...
-1
votes
1answer
78 views

One suite of tests for different implementations of a protocol

We have a logging protocol that defines how output of logging libraries should look like, e.g.: each line should be a JSON each line should not exceed 1MB There are multiple implementation of this ...
2
votes
2answers
268 views

What are techniques to run acceptance tests in a cloud app without polluting the environment with test data?

We are writing a cloud application in a micro-service architecture. We have good unit and integration test coverage for the individual services and we have a set of (public) API level acceptance tests....
1
vote
1answer
143 views

Best practice to test clustered production system

Say you have a big bloat of enterprise software and for every customer a different setup in terms of amount of appservers, search cluster size, webservers, database, loadbalancers and application-...
3
votes
3answers
52 views

Test multiple versions in acceptance

Introduction I'm working at a software company building​ software as a service. Currently we have version x.y in production and x.z on acceptance. Let's say we find a critical bug on production and ...
2
votes
2answers
158 views

How to publish 2 feature branches on QA?

I have the following scenario: Joe is working on the feature-xx branch. Richard is working in another feature-yy branch. Their company has a qa.myapp.com environment where testers work. Joe pushes ...
3
votes
4answers
328 views

In a testing phase,can I raise a defect which has occured due to deployment issues?

For an example, In a testing phase if i got a defect which is due to some delayed job restarting,can I raise it as a bug? In our project,devteam merges and deploy their codes into test site. usually ...
3
votes
3answers
199 views

Do tests that asserts a user can't do an action have any value?

Given a system with static permissions (1 permission for every action that can be made: create a resource, update a resource, etc), and dynamic roles (can be created and assign permissions to it ...
4
votes
2answers
109 views

How to test a web app (inc write paths) for acceptance or integration tests, without db access?

We are having problems in testing routes that modify the data in our API. For example the test that deletes a resource will fail if run the second time. Also due to business logic you can't create ...
11
votes
3answers
327 views

Is creating a completely duplicate system for quality assurance (QA) of another a bad practice?

At work we have a quite complicated system. Let's call this system, System_A. Our QA team has created another system, call this system, System_B, to test System_A. The way System_B is used is as ...
1
vote
1answer
160 views

Howto structure my app.js code to make it easier testable

I have a couple of Philip Hue lights in the hallway. These show the build status on their lights with a small Node.JS application. Its working like a charm. Currently I am in the process of testing ...
5
votes
1answer
114 views

Acceptance test execution strategies for heavy first-time-setup apps

We have a system with about 250 tables. The first-time-setup include running about 50 queries (known also as seeds). We're trying out strategies to automatize our acceptance tests, and our first ...
0
votes
1answer
168 views

Acceptance testing form fields (with Robot Framework)

What is best practice when writing acceptance tests for a form l without knowing the exact layout of the HTML file? Would it be for example to test that the page contains, let's say an element with ...
10
votes
4answers
317 views

Is it a good idea to have separate test methods for every step?

I am testing a REST api. Let's say it returns a JSON structure. What is the best approach to testing the server? Each test step can only succeed if all previous were successful. Structure A: test ...
2
votes
4answers
323 views

How should I manage test data in my functional tests?

I am writing automated functional tests for my application. To interact with the application, I use the SQL database to retrieve data and validate data. The main challenge that I am facing is ...
3
votes
3answers
177 views

Shared development and CI database

I'm just about to set up CI for my web application. I'm using Bitbucket and Pipeline beta as a CI. The web application is strongly coupled to the database, nothing can be tested without data in it. ...
-1
votes
4answers
552 views

Should a test scenario prepare all of its required data? [closed]

Consider a BDD scenario with some given steps that refer to existence of a set of data in database. For example consider the following scenario steps: Given there is an active customer When as and ...
9
votes
6answers
1k views

Acceptance Criteria for Edge Cases

I am a product owner on an agile team. I when doing PO acceptance testing I usually make note to try some edge cases. Its not uncommon for me to discover something and then I pass it back to the the ...
3
votes
1answer
243 views

How do you properly test a complete software replacement

We have System A (an application and a database) that is built for a specific business department and therefore has business aligned data model and table structure. System A is a mission critical ...
1
vote
1answer
349 views

Automated test for code that takes a bunch of input data and outputs a bunch of data - should it be split up?

I'm about to write a program and test(s) for it. This question is about how to structure the top-most level integration test. At the top level, the main program takes a chunk of data, and outputs ...
2
votes
1answer
667 views

Side-by-side Functional and Acceptance Testing (SpecFlow)

Edit: I have found a closely related question: StackOverflow This question is not about the differences between functional and acceptance tests! Almost all the info I could find on the web just ...
2
votes
2answers
394 views

Acceptance testing with preloaded data or filling it on the go

We're figuring out whether we should write acceptance tests that revolves around preloaded data on a database file, or programmatically added needed data per test, or filling database while testing ...
1
vote
0answers
282 views

Test for PHP Errors using Browser Emulator (Mink)

I want to know the most robust way of checking for PHP error messages when running automated tests that interact with a PHP application via a browser emulator. The reason is: I use Behat, Mink and ...
3
votes
2answers
249 views

Writing your test assertions in your function comments (just before the code)?

I'm using PHP and PHPUnit. Something bothers me: the fact that the assertions are in another class (too easy to forget or to ignore, for any new programmer in the project). If the test assertions ...
0
votes
1answer
1k views

Problems in QA Environment [duplicate]

At least few times a week I have to track down a bug that would not occur in a production\client environment. 95% of the time I can tell that its a QA configuration\environment problem just by looking ...
3
votes
1answer
251 views

GUI functional acceptance tests, making them less brittle / obstacle to further development

(Background - skip to bold statement for the crux) I'm working through the book "Growing Object-Oriented Software, Guided by Tests" by Freeman & Pryce, while applying it to a project I'm starting....
1
vote
1answer
596 views

Behat/Mink: best practice for testing strings in a web application's GUI

I'm writing acceptance tests for a web application using Behat/Mink. I want to know best practice for testing strings in the GUI. For example: say I want to test that a link exists on the homepage ...
3
votes
3answers
2k views

How do you pass/fail performance tests?

Example: A certain test is run five times on the current build, to compare it to release 1.0, where the same test was also run five times. Build 1.4 22 ms, 26 ms, 23 ms, 25 ms, 20 ms Release 1.0 ...
4
votes
3answers
771 views

Is TDD the best software development philosophy? [closed]

Question: Why not just use BDD-style acceptance tests and do away with unit tests, integration tests, functional tests and all other tests? I have been doing some research into the differences ...
17
votes
3answers
19k views

What does stubbing mean in programming?

I often hear the term stub, stub out somethings, stubs, ...etc. What does stubbing mean in programming, where the word come from? and in what contexts it can be used?(just examples)
3
votes
1answer
178 views

How specify acceptance criteria for randomness?

How would I express a Behavior Driven Development (BDD) acceptance criteria/story/scenario that indicates items should be random to some degree on a Home screen of an app like Instagram? Here's what ...
3
votes
1answer
560 views

How use same Behavior Drive Development (BDD) stories across platforms?

I'm writing an app that has a client for iOS, Android, and the web. The server is hosted on Google App Engine (Java). REST is used for the communication between clients and server. In order to ensure ...
1
vote
2answers
3k views

Why all consider UAT a validation activity? It contradicts the original idea

Virtually any book dealing with software testing mentions that user acceptance testing (UAT) is an ultimate validation activity, often quoting Boehms informal definition: "Validation: Are building the ...
1
vote
3answers
563 views

Generating test data for a search application

I have a general question about testing search applications, and what I'm looking for is pointers to resources on the topic that I can go and research on my own. I've tried semi-informed, semi-...
15
votes
4answers
2k views

How to do Test Driven Development

I have just 2+ years of experience in application development. In those two years my approach towards development was as following Analyze requirements Identity Core component/Objects, Required ...
4
votes
2answers
483 views

Whose responsibility is it to create the interface and/or acceptance testing? Developer or QA?

I am a backend developer and always create tests for my applications. Recently I study and apply the interface tests (using selenium), but I doubted whether I who should create these tests, developer ...
1
vote
3answers
398 views

Is it anti-pattern to mix unit test and web test? [duplicate]

It is a language agnostic question, e.g. I have a unit test like # Unit test User user = User.create('john'); assertEquals("User name is john", "john", user.getName()); # Web test start from here ...
2
votes
6answers
2k views

Can unit tests verify software requirements?

I have often heard unit tests help programmers build confidence in their software. But is it enough for verifying that software requirements are met? I am losing confidence that software is working ...
3
votes
1answer
287 views

Android testing - bugs not reproducible [duplicate]

We have the following problem: at the end of the iteration we give our Android app to our customers to test. Our customers report bugs that are not reproducible on our test devices. How can we deal ...
7
votes
2answers
7k views

Testing strategy for production environment [closed]

In an ideal world, dev/ops are working together as one team to release something onto production. However, there are organizations with limitations so that release engineers/teams are kept ...
4
votes
3answers
3k views

What is the best use case for selenium?

I've been trying to develop web applications while at the same time creating the testing. I understand unit testing, I can declare a test method and test specific methods in my application. But I don'...