chalk is calcium carbonate, same as limestone, so doesn't really dissolve in water unless there is acid present too. This would create a solution of soluble calcium hydrogen carbonate contained in hard water.