Police in Kwale have recovered two AK-47 rifles and 73 rounds of ammunition during a patrol on Tuesday night.
They also found two motorbikes, two knives and other personal effects, including six pairs of shoes and clothes.
Msambweni OCPD Joseph Chebusit said they suspect the one of the guns was stolen from officers recently killed at the ACK church in Ukunda.
"Our officers only collected the weapons and their personal belongings but the criminals escaped," Chebusit added.
The gang, said to be six according to the pairs of shoes, are said to be from Magutu area.
Chebusit said they have launched an operation to pursue the criminals and will identify them with their belongings.
"They pose danger to the locals if they are still free," he added.
In September, two AP officers were killed by gunmen riding on a motorbike as they were manning ACK Church in Ukunda Diani, Kwale county.
The assailants escaped after stealing one rifle from the officers.
County commissioner Kutswa Olaka said the attack happened at 10 am.
Witnesses said the two suspects armed with a fire arm made their way into the church compound and attacked the unsuspecting officers.
More officers have been deployed in the area to pursue the attackers.