The automated tracking of social insects, such as ants, could dramatically increase the fidelity and amount of analyzed data for studying complex group behaviors. Recently, data association based multiple object tracking methods have shown promise in improving handling of occlusions. However, the tracking of ants in a colony is still challenging as (1) their motion is often sporadic and irregular and (2) they are mostly present the entire duration of video. In this paper, we propose to improve the data association based tracking of multiple ants. First, we model the ant's motion using a set of irregular motion features including random walk model. Second, we use the convergence of particle filter based tracking to match tracklets with a long temporal gap. Testing results of two-fold cross validation on a 10,000 frame video shows that our proposed method was able to reduce the number of fragments by 61% and ID switches by 57%.