Private distributed ledger technology or public blockchain?

Is every chain of blocks a blockchain? What is the fundamental difference between private and public networks?