From the point of view of the device, say the floppy disk controller, it will see only the address space that its control registers are in (ISA), and not the system memory.