how did his mum die?

From what Billy Bob's drunken dad said in the movie, she put a gun to her head,he dared her to shoot and she did. So it was suicide encouraged by her husband - and part of the reason he's a drunk is because of his guilt in urging her to shoot.