The custody battle between Brad Pitt and Angelina Jolie took a new turn recently, with a judge stating Jolie has kept the kids away too much from her former husband