Why was Bert angry at Eyre?

When Eyre and Martha leave the village, Eyre goes to say goodbye to Bert, but Bert won't "forgive" him.

For what?

Bert wasn't dating Martha.

Was it for not telling him that he, Eyre, was sleeping with a married woman?

I don't understand why Eyre should need forgiveness from Bert for that??