The Samsung Galaxy S7 Active is advertised as being one of the most rugged devices on the market today. However, if Consumer Reports is correct on their findings, then these claims might need to have an asterisk appended to them. A twice run test demonstrated that Samsung Galaxy S7 Active devices don’t appear to be able to withstand their advertised water resistance of 30 minutes in 5 feet of water.

These results stand in stark contrast to those of the Samsung Galaxy S7 and S7 Edge, both of which passed Consumer Reports’ dunk test with flying colors. The first S7 Active device showed visible screen damage after its submersion in the form of green lines. The touch screen was dead, and moisture could be found on the interior of both cameras.

See also: Samsung Galaxy S7 Active review39

Just to make sure that they didn’t somehow get a faulty device, researchers took the test again with an additional device. This smartphone failed as well, if not quite so spectacularly. The screen gained a permanent flickering effect, and also got water in the camera lenses. Moreover, water was also present in the phone’s SIM card.

Researchers gave these devices time to dry out, but over the course of the next two days the situation did not improve. Both devices eventually became completely non-responsive and neither recovered.

“There may be an off-chance that a defective device is not as watertight as it should be,” said Samsung in a written statement. The company says they are beginning an investigation into this issue, but in the meantime it might be a good idea to keep your Galaxy S7 Active away from the bath. It’s possible that Consumer Reports got two defective devices, but that’s probably not a risk you want to take with such a pricey smartphone.

Next: The Galaxy S7 Active is a souped-up Galaxy S7 with a huge battery29