Non-quantized penetration of magnetic field in the vortex state of superconductors