The Averaged Null Energy Condition (ANEC) requires that the average along a complete null geodesic of the projection of the stress-energy tensor onto the geodesic tangent vector can never be negative. It is sufficient to rule out many exotic phenomena in general relativity. Subject to certain conditions, we show that the ANEC can never be violated by a quantized minimally coupled free scalar field along a complete null geodesic surrounded by a tubular neighborhood in which the geometry is flat and whose intrinsic causal structure coincides with that induced from the full spacetime. In particular, the ANEC holds in flat space with boundaries, as in the Casimir effect, for geodesics which stay a finite distance away from the boundary