Many quantum internet applications need access to multiple entangled links existing simultaneously. This requires the generation of multiple entangled links within a time window. Using single entangled link generation protocol, we model this task as a Markov decision process and propose a heuristic-based policy to generate them. This policy chooses different configuration parameters depending on the number of links in the register. Entanglement purification is also incorporated into this heuristic in different ways. To compare, we choose two baseline policies including a previously studied fixed configuration parameter policy. We show that this algorithm completes the generation up to six times faster than the baselines in our simulations and that using entanglement purification can further improve its performance.