DISCLAIMER: Potterworld or Droobledore LLC is not in any way affiliated with Mojang AB, J.K. Rowling, Warner Brothers or any company, copyright or trademark.
Is the server resourcepack enabled when you're having this issue? If so, can you try going into your minecraft folder (click here to learn how) and locate the server-resource-packs folder, then enter it & delete all the files inside the folder. After deleting the files, try relogging or select the resourcepack again with /packs, to see if it works.