Panduan Ajaib Gemika untuk Menyusun Pelajar Hogwarts menggunakan Algoritma Pokok Keputusan (Bahagian #7)

王林
Lepaskan: 2024-08-07 19:09:31
asal
869 orang telah melayarinya

7. Menghantar Mantra Pengekodan Satu-Hot ?✨

Udara kental dengan bau perkamen dan gemersik tenaga ajaib, sambil kami menyelidiki kedalaman sihir data. Hari ini, kita akan meneroka teknik menarik yang dikenali sebagaiPengekodan Satu-Hot. Bayangkan mengubahPixieyang nakal, dengan personalitinya yang bertenaga dan sifat yang tidak dapat diramalkan, kepada satu siri koordinat yang tepat pada peta ajaib. Itu, pembaca yang dihormati, adalah intipatiPengekodan Satu-Hot. ?♂️✨

Sama seperti tongkat Profesor McGonagall boleh menukar cawan teh menjadi Dachshund, mantera ini boleh menukar data kategori - label menjengkelkan yang enggan mematuhi pengiraan berangka - menjadi format yang boleh difahami oleh model kami. Fikirkan ia sebagai menukar kumpulan Hufflepuffs, Ravenclaws, Gryffindors dan Slytherin yang huru-hara menjadi grid satu dan sifar yang kemas, masing-masing mewakili rumah tertentu. ?✨

Dengan Pengekodan Satu-Hot, kami mencipta lajur baharu untuk setiap kategori unik, mengisinya dengan satu dan sifar untuk menunjukkan kehadiran atau ketiadaan. Ia seperti menyusun bunian rumah yang nakal ke dalam bilik mereka yang ditetapkan, memastikan masing-masing mempunyai ruang sendiri. Menjelang penghujung bab ini, anda akan dapat melafazkan mantra ini dengan keyakinan seorang pakar Charms yang berpengalaman, mengubah data anda daripada simpulan kusut menjadi permaidani yang tersusun dengan indah. ?✨


7.1 Data Kategori: Topi Isih dan Label Ajaib

Dalam bidang sains data yang mempesonakan, di mananombor menaridancorak mendedahkan diri mereka, kami menemui pelbagai maklumat yang ingin tahu yang dikenali sebagaidata kategori. Tidak sepertirakan sejawatan berangkamereka, titik data ini tidak mewakili kuantiti tetapi kategori atau kumpulan yang berbeza.

Bayangkan Topi Isih di Hogwarts, objek ajaib tua yang bijak yang menempatkan pelajar ke rumah mereka yang sah. Rumah - Gryffindor, Hufflepuff, Ravenclaw dan Slytherin - adalah contoh data kategori. Mereka mewakili kumpulan yang berbeza dengan ciri unik, sama seperti rumah itu sendiri. Begitu juga, jenis haiwan peliharaan yang dipilih oleh pelajar - burung hantu yang setia, kucing mendengkur atau katak pemarah - juga termasuk dalam kategori data kategori.

Data kategori adalah seperti meletakkanlabel ajaibpada objek, membantu kamimembezakandanmengklasifikasikannya. Sama seperti pelajar Herbologi akan mengkategorikan tumbuhan berbeza dengan teliti berdasarkan sifatnya, kami menggunakan data kategori untuk mengisih dan memahami unsur pelbagai dalam set data kami. Dengan memahami label ajaib ini, kami boleh membuka kunci corak tersembunyi dan melakukan mantra (analisis) yang hebat untuk mendedahkan rahsia data kami. Mari kita mencari pengetahuan lebih lanjut, apakah nilai yang terdapat di bawah ruangan Dewan, lemparkan tongkatmu wahai ahli sihir. ?✨

# Displaying the unique categories in the 'House' column unique_houses = hogwarts_df['house'].unique() print(f"Unique Houses: {unique_houses}")
Salin selepas log masuk
Unique Houses: ['Gryffindor' 'Slytherin' 'Ravenclaw' 'Hufflepuff' 'Durmstrang' 'Beauxbatons']
Salin selepas log masuk

Memahami kategori ini adalah penting kerana algoritma (atau model) ajaib kami perlu mengetahui cara mentafsir data ini. Walau bagaimanapun, algoritma ini sering bergelut dengan data bukan berangka, kerana ia lebih selesa dengan nombor. Di sinilah keajaibanPengekodan Satu-Hotberlaku.


7.2 Mengubah Data Kategori menggunakan Pengekodan One-Hot

Bayangkan rekod pelajar Hogwarts kami, dipenuhi dengan butiran yang mempesonakan seperti rumah, jenis tongkat dan subjek kegemaran. Kualiti ini sepertisigil ajaib, membawa tenaga yang unik. Walau bagaimanapun, model data kami yang cemerlang, walaupun mampu melakukan pencapaian yang menakjubkan, tidak dapat menguraikan sigil ini secara langsung. Kita mesti mengubahnya menjadi bahasa yang mereka fahami – nombor.

Masukkan mantraPengekodan Satu-Hot, mantera kuat yang mendedahkan intipati tersembunyi setiap pembolehubah kategori. Ia seperti melontarmantera Lumospadaruang tersembunyi, menerangi setiap sudut dan celah. Dengan jentik tongkat pengekodan kami, kami mengubah setiap kategori menjadi lajur tersendiri. Jika pelajar milik Gryffindor, contohnya, 1 akan muncul secara ajaib dalam lajur Gryffindor, manakala lajur rumah yang lain kekal gelap.

Transformasi ini serupa dengan mencipta permaidani ajaib, di mana setiap utas mewakili kategori. Dengan menganyam benang ini bersama-sama, kami mencipta potret pelajar kami yang kaya dan terperinci, sedia untuk dianalisis oleh model data kami. Seolah-olah kami memberikan model kami keupayaan untuk melihat dunia melalui kaca mata seorangPosyen Polijus, mengalami perspektif unik setiap pelajar. Mari teruskan dan cuba One-Hot Encoding lajur atau ciri pertama kami, akan cuba lajur jantina dahulu.

# Importing necessary libraries import pandas as pd from sklearn.preprocessing import OneHotEncoder from IPython.display import display, HTML # Assuming hogwarts_df is already defined and contains the 'gender' column # Applying One-Hot Encoding to the 'gender' column encoder = OneHotEncoder(sparse_output=False) # Updated parameter name encoded_data = encoder.fit_transform(hogwarts_df[['gender']]) # Converting the encoded data into a DataFrame and attaching it to the original dataset encoded_df = pd.DataFrame(encoded_data, columns=encoder.get_feature_names_out(['gender'])) hogwarts_df = pd.concat([hogwarts_df, encoded_df], axis=1) # Dropping the original 'gender' column as it's now encoded hogwarts_df.drop('gender', axis=1, inplace=True) # Displaying the transformed DataFrame in a scrollable pane html = hogwarts_df.head(5).to_html() # Convert DataFrame to HTML scrollable_html = f""" 
{html}
""" display(HTML(scrollable_html))
Salin selepas log masuk
name age origin specialty house blood_status pet wand_type patronus quidditch_position boggart favorite_class house_points gender_Female gender_Male 0 Harry Potter 11 England Defense Against the Dark Arts Gryffindor Half-blood Owl Holly Stag Seeker Dementor Defense Against the Dark Arts 150.0 0.0 1.0 1 Hermione Granger 11 England Transfiguration Gryffindor Muggle-born Cat Vine Otter Seeker Failure Arithmancy 200.0 1.0 0.0 2 Ron Weasley 11 England Chess Gryffindor Pure-blood Rat Ash Jack Russell Terrier Keeper Spider Charms 50.0 0.0 1.0 3 Draco Malfoy 11 England Potions Slytherin Pure-blood Owl Hawthorn Non-corporeal Seeker Lord Voldemort Potions 100.0 0.0 1.0 4 Luna Lovegood 11 Ireland Creatures Ravenclaw Half-blood Owl Fir Hare Seeker Her mother Creatures 120.0 1.0 0.0
Salin selepas log masuk

And if you scroll to the right, you might notice that the dataset now has additional two columns, the gender_Female and the gender_Male on top of the existing one, while dropping the original gender column that was there previously.


7.3 The Two Great Treasures of the Data Realm ?✨

In the grand tapestry of the wizarding world of data, there exist two primary categories of magical artifacts:Structured DataandUnstructured Data. These are the building blocks of our enchanting spells and powerful potions.

Categorical Datais akin to a well-organized Herbology garden, where every plant (data point) has its rightful place. It's like a neatly filled Hogwarts student record, with columns for names, houses, and wand types, all aligned in perfect order. Structured data is a wizard's delight, easily understood and manipulated with a flick of the wand (or a few lines of code). ?✨

On the other hand,Numerical Datais a sprawling Forbidden Forest, filled with magical creatures (data points) roaming freely. It's like a collection of owls' letters, each with its own unique style and format. This data can be as diverse as the stars in the night sky, ranging from social media posts to news articles, images, and even spoken words. While it holds immense potential, taming this wild magic requires special spells and a keen eye for patterns. ??

  1. Categorical Data (Qualitative Data):

    • Definition: Categorical data refers to information that can be sorted into distinct groups or categories based on qualitative characteristics, rather than numerical values.
    • Types:
      • Nominal Data: This type includes categories without any specific order (e.g., gender, hair color). It is often used for labeling variables without providing a numerical value.
      • Ordinal Data: This type has a defined order or ranking (e.g., customer satisfaction ratings, economic class ratings, movie ratings). The differences between the ranks may not be equal.
    • Examples: Gender, race, color, and types of products.
    • Analysis: Categorical data is typically analyzed using frequency counts, bar graphs, and pie charts. It does not support arithmetic operations like addition or averaging.
  2. Numerical Data (Quantitative Data):

    • Definition: Numerical data consists of values that can be measured and expressed numerically, allowing for mathematical operations.
    • Types:
      • Discrete Data: Countable values (e.g., number of students in a class).
      • Continuous Data: Measurable quantities that can take any value within a range (e.g., height, weight).
    • Analysis: Numerical data can be analyzed using various statistical methods, including mean, median, mode, and standard deviation.

7.4 Transforming Text into Numbers: The Magic of One-Hot Encoding

Imagine a world where numbers and words could converse, where the language of magic flowed seamlessly from one to the other. This is the realm ofone-hot encoding, a powerful spell that transforms the mysterious world of text into the concrete world of numbers.

Just as a skilled Herbologist categorizes plants by their properties, one-hot encoding sorts textual data into distinct categories. Consider the Sorting Hat, which assigns students to houses based on their unique qualities. Similarly, one-hot encoding creates separate columns for each category, with values of 0 or 1 indicating whether a data point belongs to that category or not.

For instance, if you have a column representing the houses of Hogwarts students (Gryffindor, Slytherin, Ravenclaw, and Hufflepuff), one-hot encoding would conjure four new columns, one for each house. A value of 1 in the Gryffindor column would signify a student belonging to that house, while other columns would be filled with 0s. This numerical representation allows our magical models to understand and process textual information with ease. With that being said, let's try to transform the remaining of the columns in our dataset, and see what we have to work on. ?

# Importing necessary libraries import pandas as pd from sklearn.preprocessing import OneHotEncoder from IPython.display import display, HTML # Assuming hogwarts_df is already defined and contains the necessary columns columns_to_encode = [ 'origin', 'specialty', 'blood_status', 'pet', 'wand_type', 'patronus', 'quidditch_position', 'boggart', 'favorite_class' ] # Creating an instance of OneHotEncoder encoder = OneHotEncoder(sparse_output=False) # List to hold encoded DataFrames encoded_dfs = [] # Applying One-Hot Encoding to each column and storing the result for column in columns_to_encode: encoded_data = encoder.fit_transform(hogwarts_df[[column]]) encoded_df = pd.DataFrame(encoded_data, columns=encoder.get_feature_names_out([column])) encoded_dfs.append(encoded_df) # Concatenating all encoded DataFrames into one encoded_df_combined = pd.concat(encoded_dfs, axis=1) # Concatenating the encoded DataFrame with the original DataFrame hogwarts_df = pd.concat([hogwarts_df, encoded_df_combined], axis=1) # Dropping the original columns that were encoded hogwarts_df.drop(columns=columns_to_encode, inplace=True) # Displaying the transformed DataFrame in a scrollable pane html = hogwarts_df.head(5).to_html() # Convert DataFrame to HTML scrollable_html = f""" 
{html}
""" display(HTML(scrollable_html))
Salin selepas log masuk
name age house house_points gender_Female gender_Male origin_Bulgaria origin_England origin_Europe origin_France origin_Indonesia origin_Ireland origin_Scotland origin_USA origin_Wales specialty_Auror specialty_Baking specialty_Charms specialty_Chess specialty_Creatures specialty_Dark Arts specialty_Defense Against the Dark Arts specialty_Dueling specialty_Goat Charming specialty_Gossip specialty_Herbology specialty_History of Magic specialty_Household Charms specialty_Legilimency specialty_Magical Creatures specialty_Memory Charms specialty_Metamorphmagus specialty_Muggle Artifacts specialty_Obscurus specialty_Potions specialty_Quidditch specialty_Strength specialty_Transfiguration specialty_Transformation blood_status_Half-blood blood_status_Muggle-born blood_status_No-mag blood_status_Pure-blood pet_Cat pet_Demiguise pet_Dog pet_Goat pet_Owl pet_Phoenix pet_Rat pet_Snake pet_Toad wand_type_Alder wand_type_Ash wand_type_Birch wand_type_Blackthorn wand_type_Cedar wand_type_Cherry wand_type_Chestnut wand_type_Cypress wand_type_Ebony wand_type_Elder wand_type_Elm wand_type_Fir wand_type_Hawthorn wand_type_Hazel wand_type_Hemlock wand_type_Holly wand_type_Hornbeam wand_type_Maple wand_type_Oak wand_type_Pine wand_type_Rosewood wand_type_Rowan wand_type_Sword wand_type_Teak wand_type_Vine wand_type_Walnut wand_type_Willow wand_type_Yew patronus_Cat patronus_Doe patronus_Dog patronus_Eagle patronus_Hare patronus_Horse patronus_Jack Russell Terrier patronus_Lion patronus_Non-corporeal patronus_Otter patronus_Phoenix patronus_Serpent patronus_Stag patronus_Swan patronus_Wolf quidditch_position_Azkaban quidditch_position_Beater quidditch_position_Chaser quidditch_position_Keeper quidditch_position_Seeker boggart_Ariana's death boggart_Dementor boggart_Dueling boggart_Failure boggart_Full Moon boggart_Her mother boggart_Lily Potter boggart_Lord Voldemort boggart_Severus Snape boggart_Spider boggart_Tom Riddle favorite_class_Arithmancy favorite_class_Baking favorite_class_Charms favorite_class_Creatures favorite_class_Dark Arts favorite_class_Defense Against the Dark Arts favorite_class_Dueling favorite_class_Goat Charming favorite_class_Gossip favorite_class_Herbology favorite_class_Household Charms favorite_class_Legilimency favorite_class_Memory Charms favorite_class_Muggle Studies favorite_class_Obscurus favorite_class_Potions favorite_class_Quidditch favorite_class_Strength favorite_class_Transfiguration favorite_class_Transformation 0 Harry Potter 11 Gryffindor 150.0 0.0 1.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1 Hermione Granger 11 Gryffindor 200.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2 Ron Weasley 11 Gryffindor 50.0 0.0 1.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3 Draco Malfoy 11 Slytherin 100.0 0.0 1.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 4 Luna Lovegood 11 Ravenclaw 120.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
Salin selepas log masuk

7.5 Discretizing the Numerical Values: Uncovering the Numerical Data) ✨

In the magical realm of data science, where numbers hold secrets and patterns dance in the shadows, there exists a particularly enchanting spell:one-hot encoding. This spell is a transfiguration charm, capable of transforming seemingly ordinary text into a numerical language that our magical computers can understand. Imagine a bustling Diagon Alley, filled with shops selling wands, cauldrons, and robes of every color. Each shop has a unique name, a string of letters that defines its identity. Now, picture these shop names as magical creatures, wild and untamed. To harness their power for our spells, we must transform them into something more manageable – numbers.

One-hot encoding is the spell that accomplishes this feat. It takes each unique shop name and creates a separate magical dimension (column) for it. Within these dimensions, we cast a binary spell, assigning a value of 1 to the shop that exists in that dimension and 0 to all others. It's like creating a magical grid, where each shop has its own spotlight moment. With this transformation, our once chaotic collection of shop names becomes an orderly array of numbers, ready to be analyzed and explored.?✨

7.5.1 Converting Columns with Numerical Values

To convert a numerical column with values ranging from 100 to 200 into a more machine learning-friendly format using one-hot encoding, you typically need to discretize the numerical values into categorical bins first. Here’s how to do it step by step:

You can create bins (categories) for the numerical values. For example, you might define bins like this:

  • 100-120
  • 121-140
  • 141-160
  • 161-180
  • 181-200

7.5.2 Assign Categories

Next, assign each numerical value to its corresponding bin. For example:

Original Value Category
100 100-120
110 100-120
125 121-140
145 141-160
165 161-180
180 161-180
200 181-200

7.5.3 One-Hot Encode the Categories

Now, you can apply one-hot encoding to the categorical column. Each category will be represented as a binary vector:

Original Value 100-120 121-140 141-160 161-180 181-200
100 1 0 0 0 0
110 1 0 0 0 0
125 0 1 0 0 0
145 0 0 1 0 0
165 0 0 0 1 0
180 0 0 0 1 0
200 0 0 0 0 1

By discretizing the numerical values into categories and applying one-hot encoding, you transform the original numerical data into a format that machine learning algorithms can process effectively. This method captures the categorical nature of the data while preserving the information contained in the original numerical values.

import pandas as pd from sklearn.preprocessing import OneHotEncoder from IPython.display import display, HTML # Step 1: Define bins and labels bins = [100, 120, 140, 160, 180, 200] # Define the bin edges labels = ['hp_100_120', 'hp_121_140', 'hp_141_160', 'hp_161_180', 'hp_181_200'] # Define the bin labels # Step 2: Create a new categorical column based on the bins hogwarts_df['house_category'] = pd.cut(hogwarts_df['house_points'], bins=bins, labels=labels, right=True) # Step 3: One-hot encode the categorical column hogwarts_df_encoded = pd.get_dummies(hogwarts_df, columns=['house_category'], prefix='', prefix_sep='') # Replace True with 1 and False with 0 hogwarts_df_encoded = hogwarts_df_encoded.replace({True: 1, False: 0}) # Drop the house_points column hogwarts_df_encoded.drop('house_points', axis=1, inplace=True) # Displaying the transformed DataFrame in a scrollable pane html = hogwarts_df_encoded.head(5).to_html() # Convert DataFrame to HTML & # Display first 5 rows in a scrollable pane scrollable_html = f""" 
{html}
""" display(HTML(scrollable_html))
Salin selepas log masuk
name age house gender_Female gender_Male origin_Bulgaria origin_England origin_Europe origin_France origin_Indonesia origin_Ireland origin_Scotland origin_USA origin_Wales specialty_Auror specialty_Baking specialty_Charms specialty_Chess specialty_Creatures specialty_Dark Arts specialty_Defense Against the Dark Arts specialty_Dueling specialty_Goat Charming specialty_Gossip specialty_Herbology specialty_History of Magic specialty_Household Charms specialty_Legilimency specialty_Magical Creatures specialty_Memory Charms specialty_Metamorphmagus specialty_Muggle Artifacts specialty_Obscurus specialty_Potions specialty_Quidditch specialty_Strength specialty_Transfiguration specialty_Transformation blood_status_Half-blood blood_status_Muggle-born blood_status_No-mag blood_status_Pure-blood pet_Cat pet_Demiguise pet_Dog pet_Goat pet_Owl pet_Phoenix pet_Rat pet_Snake pet_Toad wand_type_Alder wand_type_Ash wand_type_Birch wand_type_Blackthorn wand_type_Cedar wand_type_Cherry wand_type_Chestnut wand_type_Cypress wand_type_Ebony wand_type_Elder wand_type_Elm wand_type_Fir wand_type_Hawthorn wand_type_Hazel wand_type_Hemlock wand_type_Holly wand_type_Hornbeam wand_type_Maple wand_type_Oak wand_type_Pine wand_type_Rosewood wand_type_Rowan wand_type_Sword wand_type_Teak wand_type_Vine wand_type_Walnut wand_type_Willow wand_type_Yew patronus_Cat patronus_Doe patronus_Dog patronus_Eagle patronus_Hare patronus_Horse patronus_Jack Russell Terrier patronus_Lion patronus_Non-corporeal patronus_Otter patronus_Phoenix patronus_Serpent patronus_Stag patronus_Swan patronus_Wolf quidditch_position_Azkaban quidditch_position_Beater quidditch_position_Chaser quidditch_position_Keeper quidditch_position_Seeker boggart_Ariana's death boggart_Dementor boggart_Dueling boggart_Failure boggart_Full Moon boggart_Her mother boggart_Lily Potter boggart_Lord Voldemort boggart_Severus Snape boggart_Spider boggart_Tom Riddle favorite_class_Arithmancy favorite_class_Baking favorite_class_Charms favorite_class_Creatures favorite_class_Dark Arts favorite_class_Defense Against the Dark Arts favorite_class_Dueling favorite_class_Goat Charming favorite_class_Gossip favorite_class_Herbology favorite_class_Household Charms favorite_class_Legilimency favorite_class_Memory Charms favorite_class_Muggle Studies favorite_class_Obscurus favorite_class_Potions favorite_class_Quidditch favorite_class_Strength favorite_class_Transfiguration favorite_class_Transformation hp_100_120 hp_121_140 hp_141_160 hp_161_180 hp_181_200 0 Harry Potter 11 Gryffindor 0.0 1.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 1 0 0 1 Hermione Granger 11 Gryffindor 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0 0 1 2 Ron Weasley 11 Gryffindor 0.0 1.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0 0 0 3 Draco Malfoy 11 Slytherin 0.0 1.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0 0 0 0 0 4 Luna Lovegood 11 Ravenclaw 1.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1 0 0 0 0
Salin selepas log masuk

7.6 Transforming Numbers into Magical Categories: Discretizing Age ?♀️✨

Imagine a bustling Hogwarts Express, filled with students of all ages. From wide-eyed first-years to wise-cracking seventh-years, each student possesses a unique blend of magic and mischief. To better understand these young wizards and witches, we can transform their ages from precise numbers into magical categories.

This process, known asdiscretization, is like sorting mischievous house-elves into their designated chores. Instead of treating age as a continuous spectrum, we group students into specific age ranges orbins. Picture these bins as enchanted compartments on the Hogwarts Express, each holding students of similar age.

By discretizing age, we unlock a new dimension of magical insight. We can explore how different age groups perform in classes, participate in Quidditch, or even their preferred wand type. It's like casting a revealing charm on our data, uncovering hidden patterns and trends that would otherwise remain obscured. So, let's transform those numbers into magical categories and discover the enchanting secrets hidden within the age of our Hogwarts students! ?✨

import pandas as pd from IPython.display import display, HTML # Step 1: Define bins and labels for the age column bins = [10, 12, 14, 16, 18] # Define the bin edges labels = ['age_11', 'age_12', 'age_13', 'age_14'] # Define the bin labels # Step 2: Create a new categorical column based on the bins hogwarts_df_encoded['age_category'] = pd.cut(hogwarts_df_encoded['age'], bins=bins, labels=labels, right=True) # Step 3: One-hot encode the categorical column hogwarts_df_encoded_age = pd.get_dummies(hogwarts_df_encoded, columns=['age_category'], prefix='', prefix_sep='') # Replace True with 1 and False with 0 (not necessary here since get_dummies already returns integers) hogwarts_df_encoded_age = hogwarts_df_encoded_age.replace({True: 1, False: 0}) # Drop the age column hogwarts_df_encoded_age.drop('age', axis=1, inplace=True) # Displaying the transformed DataFrame in a scrollable pane html = hogwarts_df_encoded_age.head(5).to_html() # Convert DataFrame to HTML & Display first 5 rows in a scrollable pane scrollable_html = f""" 
{html}
""" display(HTML(scrollable_html))
Salin selepas log masuk

7.7 Order in the Chaos: The Magic of Naming Conventions ? ✨

Imagine a bustling Hogwarts library, books overflowing from shelves, each with its own peculiar title. Without a proper cataloguing system, finding a specific spellbook would be like searching for a needle in a haystack, wouldn't it? In the realm of data, our columns are like these books. They hold valuable information, but without a clear and consistent naming system, they can quickly become a chaotic mess. This is where the magic ofnaming conventionscomes into play.

Just as a librarian organizes books by subject, author, and title, we must impose order upon our columns. A well-crafted naming convention is like a powerful sorting spell, grouping similar columns together and making them easily identifiable. For example, using prefixes like 'student_', 'subject_', or 'score_' can instantly clarify the column's purpose.

By adopting a clear and consistent naming convention, you'll transform your data from a chaotic jumble into a well-organized magical library. This not only improves readability but also streamlines data manipulation and analysis. So, next time you're wrangling with data, remember the importance of a strong naming convention. It's the first step towards unlocking the hidden treasures within your dataset! ✨

import pandas as pd from IPython.display import display, HTML # Assuming hogwarts_df_encoded is already defined and contains the necessary columns # Manipulate column names hogwarts_df_encoded_age.columns = hogwarts_df_encoded_age.columns.str.lower().str.replace(' ', '_').str.replace('-', '-').str.replace("'", "") # Display the transformed DataFrame in a scrollable pane html = hogwarts_df_encoded_age.head(5).to_html() # Convert first 5 rows to HTML scrollable_html = f""" 
{html}
""" display(HTML(scrollable_html)) # Display first 5 rows in a scrollable pane
Salin selepas log masuk
name house gender_female gender_male origin_bulgaria origin_england origin_europe origin_france origin_indonesia origin_ireland origin_scotland origin_usa origin_wales specialty_auror specialty_baking specialty_charms specialty_chess specialty_creatures specialty_dark_arts specialty_defense_against_the_dark_arts specialty_dueling specialty_goat_charming specialty_gossip specialty_herbology specialty_history_of_magic specialty_household_charms specialty_legilimency specialty_magical_creatures specialty_memory_charms specialty_metamorphmagus specialty_muggle_artifacts specialty_obscurus specialty_potions specialty_quidditch specialty_strength specialty_transfiguration specialty_transformation blood_status_half-blood blood_status_muggle-born blood_status_no-mag blood_status_pure-blood pet_cat pet_demiguise pet_dog pet_goat pet_owl pet_phoenix pet_rat pet_snake pet_toad wand_type_alder wand_type_ash wand_type_birch wand_type_blackthorn wand_type_cedar wand_type_cherry wand_type_chestnut wand_type_cypress wand_type_ebony wand_type_elder wand_type_elm wand_type_fir wand_type_hawthorn wand_type_hazel wand_type_hemlock wand_type_holly wand_type_hornbeam wand_type_maple wand_type_oak wand_type_pine wand_type_rosewood wand_type_rowan wand_type_sword wand_type_teak wand_type_vine wand_type_walnut wand_type_willow wand_type_yew patronus_cat patronus_doe patronus_dog patronus_eagle patronus_hare patronus_horse patronus_jack_russell_terrier patronus_lion patronus_non-corporeal patronus_otter patronus_phoenix patronus_serpent patronus_stag patronus_swan patronus_wolf quidditch_position_azkaban quidditch_position_beater quidditch_position_chaser quidditch_position_keeper quidditch_position_seeker boggart_arianas_death boggart_dementor boggart_dueling boggart_failure boggart_full_moon boggart_her_mother boggart_lily_potter boggart_lord_voldemort boggart_severus_snape boggart_spider boggart_tom_riddle favorite_class_arithmancy favorite_class_baking favorite_class_charms favorite_class_creatures favorite_class_dark_arts favorite_class_defense_against_the_dark_arts favorite_class_dueling favorite_class_goat_charming favorite_class_gossip favorite_class_herbology favorite_class_household_charms favorite_class_legilimency favorite_class_memory_charms favorite_class_muggle_studies favorite_class_obscurus favorite_class_potions favorite_class_quidditch favorite_class_strength favorite_class_transfiguration favorite_class_transformation hp_100_120 hp_121_140 hp_141_160 hp_161_180 hp_181_200 age_11 age_12 age_13 age_14 0 Harry Potter Gryffindor 0.0 1.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 1 0 0 1 0 0 0 1 Hermione Granger Gryffindor 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0 0 1 1 0 0 0 2 Ron Weasley Gryffindor 0.0 1.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0 0 0 1 0 0 0 3 Draco Malfoy Slytherin 0.0 1.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0 0 0 0 0 1 0 0 0 4 Luna Lovegood Ravenclaw 1.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1 0 0 0 0 1 0 0 0
Salin selepas log masuk

And once we've satisfied with the results, let's go ahead and save the current dataset to make the next enchanting journey more easier to navigate.

hogwarts_df_encoded_age.to_csv('data/hogwarts-students-03.csv', index=False)
Salin selepas log masuk

7.8 Mapping the Magical Connections: Uncovering Hidden Relationships

Imagine a vast enchanted forest, teeming with magical creatures and extraordinary plants. Each creature and plant possesses unique qualities, and some may share hidden connections. To unveil these mysterious bonds, we must cast a spell ofcorrelation. Acorrelation matrixis like a magical map, guiding us through this enchanted forest. Each point on the map represents a different creature or plant, and the lines connecting them reveal the strength of their relationship. A thick, vibrant line signifies a strong connection, while a thin, faint line indicates a weaker bond.

As we explore this magical map, we search for patterns and trends. Are certain creatures often found near specific plants? Do particular plants thrive in the company of others? By deciphering these connections, we can uncover hidden knowledge about the forest and its inhabitants. Just as a skilled Herbologist studies the interactions between plants, we, as data wizards, uncover the hidden relationships between variables. With the correlation matrix as our guide, we embark on a thrilling adventure to explore the magical tapestry of our data! ?️✨

# Importing necessary libraries import pandas as pd from IPython.display import display, HTML # Assuming hogwarts_df is already defined and contains the necessary columns # Selecting only numerical columns numerical_df = hogwarts_df_encoded_age.select_dtypes(include=['number']) # Calculating the correlation matrix correlation_matrix = numerical_df.corr() # Displaying the correlation matrix in a scrollable pane correlation_html = correlation_matrix.to_html() # Convert correlation matrix to HTML scrollable_correlation_html = f""" 
{correlation_html}
""" display(HTML(scrollable_correlation_html)) # Display correlation matrix in a scrollable pane
Salin selepas log masuk

The Gemika

And to make our analysis easier, let's just go ahead and save the correlation matrix into a tabular format.

correlation_matrix.to_csv('data/correlation-matrix.csv')
Salin selepas log masuk

7.9 Potion Ingredients: Verifying Our Data Types ?✨

Just as a skilled potioneer carefully examines their ingredients before brewing a powerful concoction, we data scientists must meticulously inspect our data types. These data types are like the magical properties of our ingredients, determining how they will react in our spells (algorithms).

Imagine our dataset as a cauldron brimming with magical elements. Each element, be it a student's age, house, or wand type, has a specific form or essence - its data type. These types can be as diverse as the magical creatures of the Forbidden Forest:numbers(like the count of house points),text(like a student's name),dates(like the founding year of Hogwarts), and more.

Mismatched data types can lead to disastrous results, like a potion exploding or a spell backfiring. That's why we must cast a discerning eye over our data, ensuring each element is of the correct type. It's like checking if a Mandrake root is truly a root and not a disguised Goblin! Only then can we confidently proceed with our magical data transformations. ?♀️✨

# Importing necessary libraries import pandas as pd from IPython.display import display, HTML # Assuming hogwarts_df is already defined and contains the necessary columns # Setting display options to show all columns and prevent truncation pd.set_option('display.max_columns', None) # Show all columns pd.set_option('display.expand_frame_repr', False) # Prevent truncation in output # Checking the data types of each column data_types_df = hogwarts_df_encoded_age.dtypes.to_frame(name='Data Type') # Convert data types to a DataFrame # Displaying the data types in a scrollable pane data_types_html = data_types_df.to_html() # Convert DataFrame to HTML scrollable_data_types_html = f""" 
{data_types_html}
""" display(HTML(scrollable_data_types_html)) # Display data types in a scrollable pane
Salin selepas log masuk
Data Type name object house object gender_female float64 gender_male float64 origin_bulgaria float64 origin_england float64 origin_europe float64 origin_france float64 origin_indonesia float64 origin_ireland float64 origin_scotland float64 origin_usa float64 origin_wales float64 specialty_auror float64 specialty_baking float64 specialty_charms float64 specialty_chess float64 specialty_creatures float64 specialty_dark_arts float64 specialty_defense_against_the_dark_arts float64 specialty_dueling float64 specialty_goat_charming float64 specialty_gossip float64 specialty_herbology float64 specialty_history_of_magic float64 specialty_household_charms float64 specialty_legilimency float64 specialty_magical_creatures float64
Salin selepas log masuk

7.10 Gemika's Pop-Up Quiz: Spotting the Trends

And now, dear apprentices, Gemika Haziq Nugroho has prepared a quiz to test your understanding of this powerful encoding spell. Are you ready to decode the mysteries of One-Hot Encoding?

  • What is categorical data, and why is it important in data analysis?
  • How does One-Hot Encoding transform categorical data for machine learning models?
  • Why do we drop the original categorical column after applying One-Hot Encoding?

Answer these questions to prove your mastery over the art of data transformation. As we continue our journey through the magical world of data science, remember that each spell we learn brings us closer to unveiling the secrets of our enchanted dataset. ??♂️✨

With these newfound skills, you're well-equipped to handle categorical data in any dataset. The path to becoming a master data wizard is full of wonder and discovery, and with each step, we draw closer to the heart of the magical data that surrounds us. Let us press on, eager to learn and ready to explore! ??


Atas ialah kandungan terperinci Panduan Ajaib Gemika untuk Menyusun Pelajar Hogwarts menggunakan Algoritma Pokok Keputusan (Bahagian #7). Untuk maklumat lanjut, sila ikut artikel berkaitan lain di laman web China PHP!

sumber:dev.to
Kenyataan Laman Web ini
Kandungan artikel ini disumbangkan secara sukarela oleh netizen, dan hak cipta adalah milik pengarang asal. Laman web ini tidak memikul tanggungjawab undang-undang yang sepadan. Jika anda menemui sebarang kandungan yang disyaki plagiarisme atau pelanggaran, sila hubungi admin@php.cn
Artikel terbaru oleh pengarang
Muat turun terkini
Lagi>
kesan web
Kod sumber laman web
Bahan laman web
Templat hujung hadapan
Tentang kita Penafian Sitemap
Laman web PHP Cina:Latihan PHP dalam talian kebajikan awam,Bantu pelajar PHP berkembang dengan cepat!