"Never give up" doesn't mean that you stay with a failed idea or business. It means that failure doesn't take you down. You learn from the failure and move on. The vast majority of entrepreneurs fail far more often than succeed.