Question about Ppl Joining

Why is my brother having trouble joining my Minecraft world with add-ons? I have RealismCraft and Actions & stuff on my world and whenever they try to download the add-ons it either doesn't download at all or it says lost connection to host. To clarify I only have the mods and he doesn't.