Four people have drowned over the weekend due to bad sea conditions