All articles

How we test auction software every day: the daily chain test

By Gerrit-Jan Bogert, Founder of Hameriq ·

An auction cannot go wrong on the evening of the gala. A bid that is not registered, an outbid e-mail that never arrives or a lot that closes too early costs money and trust. That is why we do not only test new code before it goes live: every morning we run the whole bidding chain on the live platform. This article explains how.

Written by the team behind Hameriq. Hameriq is our own product, so we mention it where it fits; everything else in this article applies whichever software you use.

The daily chain test

Every morning after six o'clock (Brussels time) an automatic test runs on a separate test auction house that is not visible to the public. It creates a test auction with test bidders and goes through the same steps as real people, on the real platform.

Because it runs on the live system and not on a copy, it also catches problems in configuration, e-mail delivery or external services that a test environment would miss.

What is checked

Among other things, the chain test checks:

  • Registering and signing in as a bidder
  • Placing bids and proxy bids, and the bidding rules behind them
  • The late-bid extension and the closing of lots
  • Outbid e-mails, closing the auction and the winner's payment record
  • Password e-mails, including links that survive company mail scanners
  • Bidder names in the public bid history only when the bidder chose to show them
  • Blocked bidders, lots that are not open yet and security checks such as no anonymous bidding

When something fails

The test sends a report by e-mail every morning. If a step fails, a ticket is opened automatically for our team, so the problem is solved before auction houses notice it.

When we change a bidding rule or an e-mail, we change the test with it, so the morning report always shows the platform as it really works.

Monitoring every ten minutes

Next to the daily test, a watchdog checks the platform every ten minutes: are auctions closing on time, are e-mails leaving, are background jobs running? Every alert is sent to our team and serious problems become a ticket. An external monitor checks the platform around the clock, and a screen test and a security scan run every day as well.

Test auctions for auction houses

Auction houses can test too. On Hameriq any auction can be marked as a test auction: bidders see a clear notice that bids are not binding, and the organiser can clear all test bids afterwards. That is ideal for a rehearsal with volunteers before a gala. Real auctions can never be reset.

Why we write about this

When you choose auction software, ask the provider how they test and how they notice when something goes wrong. A provider that tests every day and can tell you exactly what is checked gives you more certainty than a long list of features.

See it working in the demo

Open the demo auction, place a bid on your phone and watch the live screen update. Open the demo

Frequently asked questions

What is a chain test?

A test that goes through the complete chain a real bidder follows, from registration to bidding, being outbid and winning, on the live platform.

Do the test bids affect real auctions?

No. The chain test runs on a separate test auction house with test auctions and test users that are not public.

Can I test my own auction before it starts?

Yes. Mark an auction as a test auction, let volunteers bid, and clear the test bids afterwards.

What happens if the test finds a problem?

The morning report shows the failed step and a ticket is opened automatically for our team.

Read also