TestChat

Exploratory Testing
A testing chat on Exploratory Testing
   7 years ago
#TestChatAutomation TestingA testing chat on Automation, specifically the applications for using it in testing.
   7 years ago
#TestChatAIA testing chat on AI
Ministry of Testing
Big thank you to everyone that made it to the chat tonight! It was awesome again. We're always open to suggestions for chats & of course you can chat more on The Club https://club.ministr... #testchat
Exploratory Testing
All things Exploratory Testing, or should that just be testing...
Ministry of Testing
Q3. How do you record and share discoveries from your exploratory testing? #testchat
Swati Shah
Write results in notebook and send email to squad with charter and results...
Amber Race
Any bugs or task suggestions go into JIRA for safekeeping. Straightforward
Richard Bradshaw
I use to do mindmaps. Colour code and a notes. But it started to get hard to manage, and preferred pen and paper as I had more freedom to doodle and record observations
Deborah Lee
colour coded spreadsheet (for now) but would like to start mindmapping
Toyer M
Screenshots, email, log files and face to face hands on show and tell
Deborah Lee
screenshots / licecap for gifs
Jasmin
I write initial notes in a notebook and then have direct conversations with my PO and developers, often with a live demo. If something I discovered needs action, it goes on a sticky on our scrum board.
Andrea Hüttner
what I scribbled on my notepad I summarise into Testlodge and save that in the dedicated QA place for that release/customer. Bugs are recorded in Jira.
Richard Bradshaw
so now I take notes and use a key to help me review them afterwards. So if a write a bug I'll draw a bug in the margin, if I have a question for someone I'll draw a ?, a flag if I need to flag something
Conor Fitzgerald
typically record in simple text editor and share findings with the team verbally, results in interesting discussions
Butch Mayhew
Mac: Images: Custom Shortcuts to save screenshots or copy selection to clipboard + preview + upload to ticket tracker.
Heather Reid
screenshots, screen recorder, face to face chat with devs
Tracey Baxter
Evernote, mind maps, process flows
Lee Marshall
Curious on answers to this so I can sell ET to work.
Katalin Honti
Bug tracking tools, now TFS
Fifty Grades of Shey
I'm quite a fan of Mindmup for mindmapping as it hooks into google drive easily.
Patrick Prill
mindmaps, relevant comments in stories, walkthrough, JIRA tickets
Deborah Lee
@nu_fenix i've kept a note of all the bugs i've found through exploratory testing as opposed to scripted. SO many more found through ET
Richard Bradshaw
I'm a huge fan of section based test management (SBTM). It provides some structure, so I do 2 hours sessions, meaning I don't have information overload when I share with the rest of the team http://www.satisfice...
Simon Tomes
@FriendlyTester Likewise for mind maps. I think they're good for hashing out ideas but I've always struggled to use them to capture my notes during a session. #testchat
Del Dewar
Mindmaps to illustrate a graphical chain of thought that spans charters/sessions. Good for small focused efforts. Gets unwieldily if too big #testchat
Butch Mayhew
Videos/Animations: Recordit - to create animated gifs easily http://www.recordit....
Jasmin
@heather_reiduff I really love the face to face communication. I feel like a lot gets lost with written recaps. The devs are usually more engaged and ask questions about how something was tested
Del Dewar
I think as long as you have a coherent narrative in mind that's the most important aspect of conveying a testing story #testchat
Lee Marshall
@DeborahLee89 Nice to hear. Managers think ET is only for gaming industry, not finance sector.
Amber Race
@jasmintestscode Yes, my team is sitting all around me, so communication is simple
Tracey Baxter
Attach session notes to related story/feature so whole delivery team can see
Richard Bradshaw
recording your screen while ET can be highly rewarding. Also the logs. So you can provide actual proof you exercised the system. Not just a tick in a box.... or pressing 'pass'
Andrea Hüttner
So many people mentioning MindMap. Wasnt a friend of it so far (used it for other stuff) but maybe I have to try to use it for ET!
Simon Tomes
Currently on a client site I use Google Docs. I split each time-boxed session into three sections: Planning, Setup and Exploring. I then have to link to this in the appropriate JIRA. It seems to do the job. #testchat
Butch Mayhew
We use Jira (Create test session) for our test sessions/charters to track testing progress.
Heather Reid
@jasmintestscode & they're much less likely to feel offended when a bug was found & more open to talk about potential solutions
Jasmin
@FriendlyTester +1 for SBTM! The structure forces me to take breaks and reset my brain between sessions and provides convenient time to review results with dev/PO
Richard Bradshaw
I need to write about this. I've also tried heatmaps. So model the system, and map commits to it to gauge a score. Then layer checks and ET sessions on it, to show the focus applied verse the perceived risk
Andrea Hüttner
@FriendlyTester I tried to use a recorder (forgot which one, the one recommended by James Bach...).. files got soooo big....
Anne-Marie Charrett
pairing with a developer :)
Amber Race
@nu_fenix As far as I can tell, the testing procedures at my gaming company are much better than those at Equifax, so finance should take another look :)
Toyer M
Mind maps has changed the game for my team, we also added cool symbols and colours to mark different things
Simon Tomes
When not on a client site I use TestBuddy (a tool I'm building with Rajit Singh). It helps testers capture and share their notes. https://testbuddy.co #testchat
Tracey Baxter
@FriendlyTester nice! Would like to hear more about this
Del Dewar
I refer you to @SimonSaysNoMore 's excellent CAST talk about how he creates, categorises and logs his testing sessions.
Butch Mayhew
For sharing our findings its normally a conversation with a dev followed up with any bugs opened in jira with clear steps to reproduce.
Andrea Hüttner
@ButchMayhew What, does it have a specific feature for sessions?
Toyer M
@FriendlyTester what tool do you use for heatmaps?
Richard Bradshaw
@nu_fenix yes. So create a model of the system with 'sections' aka Profile, Directory, Admin etc. Then map commits to those areas to get an idea of change. More changes means more thinking or more focus. Then use same model on checks
Simon Tomes
I've also found this with videoing a whole session. I think it misses a trick of getting to the juicy bit – just a lot of not so interesting video to trawl through. Perhaps one day they'll be a tool to help with this. #testchat
Mark On Task
For collaborative exploratory performance sessions, I share lots of images, stats, urls and views into a chat session/slack/hipchat with others
Patrick Prill
@deefex read about them lately, still very undecided about the usefulness
Toyer M
@FriendlyTester amazing idea! Any tips on how to map the commits?
Del Dewar
@TestPappy Ah, but useful to who? Session logs are primarily for the tester's benefit, no?
Jasmin
I've also been mob testing with my devs lately - the sharing happens along with the testing!
Simon Tomes
@deefex this reminds me of @Marcel_Gehlen's incredible Pathway Exploratory Testing post. So much useful information! http://thatsthebuffe... #headexplodes #testchat
Conor Fitzgerald
@jasmintestscode mob testing brings huge benefits
Patrick Prill
@deefex imo it’s a bit steamroller tactics to press everything into sessions for documentation and archiving
Amber Race
@jasmintestscode I wish I could get my devs to pair or mob - they get very bristly
Richard Bradshaw
@FriendlyTester @nu_fenix decide what risks are remaining, Then plan your ET sessions accordingly then add them to the map. and reduce the 'heat' So 100+ changes is red. Checks took it to orange, two ET sessions get me to green
Ana
write down everything that needs follow-up on post-its, talk to product to see if they feel like any of the findings require immediate action. the bugs are written down in Jira in either case, and put in the current sprint if they're hot
Heather Reid
@ambertests probably too long for this but do they give reasons why they're bristly?
Deborah Lee
i think pair testing (either with other testers or devs) to show the benefit of the way we work, and how we explore. @nu_fenix this could be a good idea to sell it too
Amber Race
@heather_reiduff They just want to do their own work alone. Totally fine with code reviews, though
Del Dewar
@TestPappy We need to talk about this, my grumpy brother. ;-) #testchat
Jasmin
@ambertests it started with me mobbing on the development with them - they saw the benefits there and (luckily) were happy to try it out for testing as well
Simon Tomes
I write notes imagining I'm taking someone through my actual process/steps/thoughts whilst exploring. Imagine saying it out loud and just type. Can always edit later before debrief/sharing #testchat
Richard Bradshaw
some of the most important discoveries to share are. Shit worked!!! If it works, tell people to praise the team. But also, that more sessions may be needed, I discovered we need to do more.
Fifty Grades of Shey
@simon_tomes Hadn't seen that article. Thanks for the share.
Lee Marshall
@DeborahLee89 A sub-team has tried pair, but they see it as taking twice the overall time.
Lee Marshall
@nu_fenix I want to get more doing it, and also try mobbing after reading about it.
Patrick Prill
@deefex sure, mate. You know where to find me.
Lee Marshall
@FriendlyTester I do that with devs, so they don't associate me coming to them as bad news only.
Heather Reid
@ambertests would they try it as an experiment/one off then if they don't like it, retrospect on why. Drop it then if it's too much?
Del Dewar
@simon_tomes Yeah, he mentions TestBuddy quite a few times, doesn't he? ;-) #testchat
Del Dewar
@TestPappy Manchester, in a few week's time.