Speaking in an interview on Ala C's YouTube channel, the father of three said his dad was a street preacher and the family depended on the offerings they got from the street.
"I grew up in Nairobi and the poverty here is very bad since if you have nothing to eat, you can't get it elsewhere. But in shags, you can go to the farm and get something," he said.
"We were very poor that we could not afford the basic needs."
Pitson said he hated God since they were suffering yet his dad was serving God.
"I did not even want to be associated with the church until later, when God gave me a second chance and I started learning about him," he said.
Today, Pitson also serves as a reverend at Karura Community Chapel.
He compares his service to the church as great since he has a salary and medical cover, which was not there before.
Speaking about the limitations of growing up in a Christian family setup, Pitson encouraged pastors to let their children decide when to serve God.
He said his mum was prayerful and that the children did not have the luxury of doing evil.
"I joined praise and worship at the age of 11 years. The problem comes since your whole life, you have been in church, you have learnt everything right, but you do not have the freedom," he said.
"It is good to preach to your children but don't be too strict. Let them get saved on their will. Not the God of my dad but my God," he said.
"I did not have that exposure to discos and clubbing. My first time going to a club, I went to campaign as a student leader."
He would later go as an artiste to perform, although he said he was highly criticised.
"I was invited by rapper Nonini to sing my song 'Lingala ya Yesu'," he said.
"The backlash that followed, I vowed to stay away from performing in clubs. I do not want to go to clubs."
Asked if he would preach in clubs, Pitson said he would prefer to stay away.
"Why are they not coming to the church? You don't swim inside to fish. You can't fish while swimming with the fish," he said.
"It is not bad if you have the call to go to clubs. But if you are weak, don't go and preach in clubs."
Pitson also talked about how he almost lost his marriage for keeping mistresses and sponsoring their lifestyles.