The water emerging at Deildartunguhver is just about boiling hot, so don't be tempted to lean over the low fence to check the temperature.  The smell of sulphur is very prominent.