Henry, with increasing sentiment as the years passed, found himself distancing from the Church. Henry will always declare himself a devout Christian, a proper Christian, too, (or at least trying), but doesn't find the Church as a holy institution, as the authority on God's word, to be whole or complete. This has always been true, but as the rumblings of malcontent bubbled in Bohemia with the growing popularity of Jan Hus' teachings, by the time 1420 struck with the papal crusades of Bohemia (the Hussite Wars), Henry had grown more distant from the Catholic Church.
Jan Hus, a famous Czech theologian who is often considered the first reformer of the Church, challenged many aspects of the Catholic Church in Bohemia. In particular, Hus denounced the Church's stance on simony (the act of selling church offices, appointments, and sacred artifacts) and especially indulgences in which Hus vehemently condemned, believing the practice to be used primarily for the Church's financial gain as opposed to any sort of spiritual salvation or penance. Henry had grown up repenting in what ways he could for the sins he'd committed, some of them, indeed, through paying fees to indulgence boxes, reasoning that the Church knew better of God's word than he himself. In short, Henry, though a consummate sinner (i.e. had killed, had lusted, had stolen, had drank and indulged in excess, had blasphemed, had coveted a neighbor's wife [or husband, if the verse sees him romancing Hans], and had sodomized [which was all sexual acts that did not lead to conception, regardless of the sex of the lovers] to name a few) still listened to the Church's teachings where it was convenient, and did not question what they deemed proper or correct. After all, he still held to his faith closely.
This changed as he got older, Bohemia devolving into further religious unrest especially as King Wenceslas supported Jan Hus, particularly as he saw Jan Hus as a potential boon in his opposition to the Archbishop of Prague, Zbyněk Zajíc. Henry saw more the greed of the Church, but saw, too, the greed of kings and the political machinations he had little love for and little understanding of. For Henry, once the Hussite Wars properly began and he had found himself under Jan Zizka, a Hussite, he saw himself as aligning first and foremost to those he cares for. Those he loves. He is devout, that, he would never deny, but the interpretation of the Word and its influence in royal hands had sidled him toward the angle of the disillusioned -- not from his faith, mind you, but solely from the religious institution.
Some core beliefs held by Jan Hus that Henry found himself agreeing with, however, are as follows (from most to least, though all were held favorably):
The teaching of the Bible in Czech as to be more accessible to common folk. Latin was the language used for the clergy, and Latin was only known by nobles and the clergy. As such, there was always a rift between the peasants and the Church and, in Henry's belief, God.
The condemnation of indulgences as a tool of financial gain for the church. To repent, one must seek it truly and honestly, not through money.
Simony or the practice of the selling of Church offices for, again, financial gain, was rampant and should be discouraged,
The supremacy of the Bible. Anything that contradicted the Bible (i.e. laws) should be rejected. (This is, as you can imagine, contradictory and hypocritical for Henry who often approaches his faith in that way HE interprets it. He isn't perfect and would never claim to be!)
Belief in the clergy returning apostolic, or that the clergy should more seriously forego earthly possessions and power.
Henry's father, Radzig Kobyla, was an ardent supporter of Hus up to Radzig's assassination by anti-Hussites in 1416. His father's death further won Henry's sympathies to Hussite beliefs and their faction. It's worth nothing that most of Bohemia was rather taken by Jan Hus' teachings. In fact, after Jan Hus was tried and executed (via burning at the stake) in 1415, a protest was drafted and sealed by a great host of nobles from Bohemia and Moravia to protest Hus' death. This further radicalized the Bohemian peoples who distanced themselves more from Papal teachings and the Catholic Church. As a result, Rome declared a crusade against Bohemia which kicked off the Hussite Wars wherein most of the Bohemian population sided with the Hussites.
Yet, after the war, Henry is still ousted for his warring against the Holy Roman Empire and had folk visibly recoiling from him, distrusted for the brand on his neck. After all, he has visible proof that he may stir trouble and already has. However, most folk in the country, once they learn of his side in the war, soften to Henry's predicament (verse dependent, i.e. in some he is on his own without a lord or land, and another where he is under Hans Capon's surviving heir, though still visibly marked by war and hardship) and are more amenable to lending him a place to stay or eat if necessary.