Hi! Figured I'd answer both here!
One of the best analyses I've ever seen of what the heck is wrong with Victor's father comes from @dross-the-fish. I'd head to his blog and search "Alphonse," because he has several posts discussing this in detail, with textual support, and breaks it down brilliantly.
Now, I do have a degree in English literature and write professionally so I should pull out my copies of the novel and cite my sources here but also...........it's the weekend and I do not want to lol.
Alphonse is fundamentally about presenting his family as idyllic and perfect to the outside world, and has a habit of either brushing unpleasant things under the rug or completely failing to recognize how troubling they are in the first place.
Exhibit A: Caroline, Victor's mother. Victor mentions that there is a "considerable" age gap between the two of them, and it's inferred that Caroline was a teenager when Alphonse--an older, fully-grown man, mind you--took her in and then eventually married her. It's skeevy, it's weird, and it smells suspiciously like grooming. Sure, okay, fine, "That was the way things were in the late 18th century." That does not make it okay, and Mary Shelley would have been hyper-aware of that dynamic more than anyone.
Predation in relationships shows up a lot in the novel, starting with Victor's father. What else was Caroline supposed to do? Her father's friend takes care of her, shows her kindness, and she has literally no other options. As a woman in the 18th century, she is stuck. So when he sidles up to her and marries her the second she's old enough to wed, she accepts. She has no other choice. We're given to believe that they loved each other deeply, but of course, you have to question the origins of this love. Adult man takes in a literal teenager only to marry her soon after. That AIN'T A GOOD LOOK.
Also, as @dross-the-fish points out, it's mentioned at one point that Alphonse's favorite painting of Caroline (which HE commissioned, mind you! He paid an artist to paint it!) depicts her as a child weeping over the grave of her dead father (who was Alphonse's best friend). He hangs it in a prominent place in the home. He admires it all the time.
How are we supposed to unpack that suitcase? Has Alphonse preserved her childhood suffering to remind himself that he's the patriarch and hero? Is he into the idea of a child mourning the loss of a parent?
Is Caroline only an emblem to him--something which he may acquire and pet and dote on and mold into the perfect little wife? (The men in this novel, including the Creature, often view women like this: as molded and made for men. The Creature, I suppose, has something of an excuse at first, since he knows nothing else, but everybody else...yikes.)
There's a whole other racist lil suitcase of Alphonse and Caroline later taking in Elizabeth, specifically, instead of the other Italian children because she's fairer and prettier than the kids with darker skin. Yeesh. (This happens in the 1831 version; in the 1818 version, she's Victor's cousin and Alphonse takes her in sight unseen since she's family.)
Exhibit B: Alphonse does not tolerate unpleasantness. When Victor is understandably distressed because of all the, you know...murder...the best way Alphonse can think to deal with it is to effectively say, "Buck up, kiddo, let's not talk about things like that. Try being happy. Have you tried not being sad?"
I mean, holy Lord, there are an usual amount of deaths popping up all over the place, Alphonse; is your son not entitled to his distress?
It's giving "Turn It Off," but for uncomfy emotions, period:
He's also at turns quite dismissive of his children's interests. When young Victor excitedly tells Alphonse about his burgeoning interest in alchemy, Alphonse immediately dismisses it as "sad trash." And fine, sure, it's antiquated by the 18th century but we learn eventually some part of it taught Victor something because it works and here comes an eight-foot-tall Creature!
For Victor, who is already grieving the loss of his mother (another thing we DO NOT LINGER ON, KIDS, says Alphonse; You can be sad about your mother but not so sad that it starts to disrupt the facade of happy harmony I have to maintain!), this dismissal isolates him further, and he retreats deeper into his studies. He only finds real intellectual kinship at university, not with his father.
Also! Alphonse immediately shoves Elizabeth into Caroline's mothering role after the latter dies. Immediately. He expects her to be pleasant and accommodating and to take care of everyone else without complaint. Never mind what Elizabeth wants; the men have decided for her. There's no room for even the notion of questioning. She's going to take care of everyone just like Caroline did and she's going to marry Victor because Caroline asked her to on her deathbed--you don't want to make your dying mother unhappy, do you? (Caroline's a whole other can of worms, man. She didn't really stand a chance, either, but that doesn't mean her choices are okay.)
And again, when Justine and William die and Elizabeth is, understandably, incredibly upset, Alphonse contacts Victor to take care of it because he's at a loss. He can't deal with it, although he's mentioned he's tried. And sure, this is understandable to an extent, but given Alphonse's history of quickly shoving emotions that make him uncomfortable into the cupboard, it's telling that he passes a traumatized Elizabeth onto someone else. She's no longer playing the dutiful Caroline Part II and he can't handle it. Oh, no! She's a person? "Victor, get back here, she's breaking protocol!"
Ultimately, while both of Victor's parents do show their children love in the only ways they know how to, Alphonse is very much a man of his time: wealthy, with a noble name and family image to protect. One could argue that his willing obliviousness to Victor's inner turmoil indirectly leads to disaster. He's a "no news is good news!" sort of fellow because it's easier to be so. Victor insists his childhood was a happy one, and it's clear he had plenty of happy moments. But critical textual analysis shows us that there were some strange family dynamics happening even before he was born.
And Alphonse shacked up with a teenage girl and that is gross no matter what century it is, the end.