More than 200 people trooped to the Laikipia West Sub-County offices after their houses were torched in an attack sparked by the killing of two men in the area.
Police said on Wednesday that they had dispatched more security personnel to enhance operations and address the fear and tension.
Police explained that the Tuesday drama was ignited by an earlier killing of a man in the Matigari area over claims of a love triangle.
One Dancun Lenkirikai, 35, was found dead in his house with deep cuts on his body.
Preliminary investigations revealed that the deceased had a disagreement with the other two men over a woman before he was killed.
News of the death sparked retaliation from his community in the area.
A group reacted and killed one Steven Lokirin, 39, and set his house ablaze.
The attackers also set fire to several other structures in the area, raising tension and forcing locals to flee for safety.
Police said the attackers stole an unknown number of livestock, but 44 animals were later recovered and returned to the owners.
The bodies of the men were later moved to the local mortuary pending investigations and autopsy.
Local administrators addressed the group and assured them of security, but they declined to return to their homes.
On Wednesday, tension remained high in the area, with fears of more attacks from the gunmen.
More security personnel were mobilised to the area to ensure calm and diffuse the tension.
The Internally Displaced Persons were registered by local Kenya Red Cross officials for further processing.
The area is usually volatile, as communities living there keep fighting over resources, including grazing fields and livestock.
Laikipia is among the counties under Operation Maliza Uhalifu, aimed at addressing cattle rustling.
The operation covers at least seven other counties and has so far managed to contain the incidents in some areas.
The attacks have, however, been persistent.