I'v had it happen to me before too haha. Sometimes I'll be speaking to a chinese friend in mandarin and they suddenly insert an english word because they might think I don't know it in chinese or whatever and it always goes right past me and takes a minute to realize.