DACON
search Subscribe
noti 0

    MY XP

    XP Info

    LEVEL 1

    Until Next Level 150 XP

    0/150 XP

    Today's XP

    0 / 800

    Total XP

    0

    Earned XP

    0

    Spent XP

    0

    Sign in with your SNS accounts

    google
    Sign in with Google
    Don't have an account? Sign Up
    Verify your email

    To sign up, you must verify your email. Do you want to resend the code?
    [Dacon] sign up verification

    Your email must be verified to complete the sign up process. Please verify your email below to complete.

    Terms of Use

    Privacy policy

    Consent to receive marketing information

    1. Promotional Information Usage


    a. DACON provides promotional information such as user-tailored services and product recommendations, various prize events, promotions,

    and competition announcements to users through email, postal mail, text messages (SMS or KakaoTalk Alert), push notifications, or phone calls


    b. Users may refuse marketing communications and can withdraw consent at any time.

    Refusing consent will not restrict access to DACON's core services.

    However, marketing information services such as discounts, event notifications, and personalized recommendations will be limited.


    2. Disadvantages of Non-Consent

    a. Under Article 22(5) of the Personal Information Protection Act, refusal of optional information consent does not affect service availability.

    b. However, marketing information services including discounts, events, and personalized recommendations will be limited


    3. Withdrawing Service Communication Consent

    a. To opt out of DACON's marketing communications, go to 'Home > Account Management Page > Marketing (Competitions, Education, etc.) Information Reception Consent (Optional)' at the bottom of the page

    b. Consent can be reinstated anytime through the same path ('Home > Account Management Page > Marketing (Competitions, Education, etc.) Information Reception Consent (Optional)’) for future marketing benefits.


    2021.05.25

    HD Hyundai AI Challenge

    알고리즘 | 채용 | 정형 | 조선해양 | 회귀 | MAE

    Practice
    Overview Data Code (share) Talk Leaderboard

    Setup D-0

     

    범주형 변수 관련 인코딩 질문

    edwinjungwoo
    2023.10.23 20:11 2,641 Views
    comments 2

    안녕하세요, 대회에 참가하는 학생입니다.

    다름 아니라 대회 규정에 아래와 같은 규정을 보고 의문이 생겨 문의 드립니다.

    • Test 데이터에 pandas의 get_dummies() 함수를 적용하는 경우

    주어진 데이터 중 범주형 변수에 대한 원핫인코딩이 금지된 것인지, Baseline에 제시된 것처럼 라벨인코딩만 가능한 것인지 궁금합니다.

    감사합니다.

    2 Comments
    Login Required
    0 / 1000
    DACON.GM
    2023.10.24 09:12

    안녕하세요 edwinjungwoo님,
    문의에 대한 답변입니다. Test 데이터에 직접 pd.get_dummies() 함수를 사용하는 것이 금지되는 이유는 이 방법이 Data Leakage를 일으킬 수 있기 때문입니다. 
    특히, 학습 데이터에 없는 새로운 카테고리가 테스트 데이터에 포함된 경우, 이 새 카테고리에 대한 정보가 자동으로 모델에 반영되어 버리기 때문에 이러한 상황이 발생합니다. 
    따라서, 범주형 변수 처리 시 학습 데이터에서 사용한 동일한 전처리 방식을 테스트 데이터에도 적용하는 Label-Encoding과 같은 방식을 적용해야합니다.
    감사합니다.

    edwinjungwoo
    2023.10.24 19:55

    답변 감사합니다! 참고해서 작성하겠습니다.

    📣 The comment input field has been moved to the top of the comment list!
    to_list List
    Previous
    데이터 명세 및 도메인 용어 설명 (23.10.18 수정)
    Competition - HD현대 AI Challenge
    Likes 10
    Views 6,764
    Comments 18
    2yr ago
    Current
    범주형 변수 관련 인코딩 질문
    Competition - HD현대 AI Challenge
    Likes 6
    Views 2,641
    Comments 2
    2yr ago
    Next
    외부데이터 관련 질문
    Competition - HD현대 AI Challenge
    Likes 5
    Views 2,451
    Comments 2
    2yr ago