Random row selection in Pandas dataframe
--------------------------------------------------
Hire the world's top talent on demand or became one of them at Toptal: https://topt.al/25cXVn
and get $2,000 discount on your first invoice
--------------------------------------------------
Music by Eric Matyas
https://www.soundimage.org
Track title: Horror Game Menu Looping
--
Chapters
00:00 Random Row Selection In Pandas Dataframe
00:33 Accepted Answer Score 72
00:50 Answer 2 Score 12
01:05 Answer 3 Score 413
01:37 Answer 4 Score 5
01:50 Thank you
--
Full question
https://stackoverflow.com/questions/1592...
--
Content licensed under CC BY-SA
https://meta.stackexchange.com/help/lice...
--
Tags
#python #pandas #random
#avk47
Hire the world's top talent on demand or became one of them at Toptal: https://topt.al/25cXVn
and get $2,000 discount on your first invoice
--------------------------------------------------
Music by Eric Matyas
https://www.soundimage.org
Track title: Horror Game Menu Looping
--
Chapters
00:00 Random Row Selection In Pandas Dataframe
00:33 Accepted Answer Score 72
00:50 Answer 2 Score 12
01:05 Answer 3 Score 413
01:37 Answer 4 Score 5
01:50 Thank you
--
Full question
https://stackoverflow.com/questions/1592...
--
Content licensed under CC BY-SA
https://meta.stackexchange.com/help/lice...
--
Tags
#python #pandas #random
#avk47
ANSWER 1
Score 413
With pandas version 0.16.1 and up, there is now a DataFrame.sample method built-in:
import pandas
df = pandas.DataFrame(pandas.np.random.random(100))
# Randomly sample 70% of your dataframe
df_percent = df.sample(frac=0.7)
# Randomly sample 7 elements from your dataframe
df_elements = df.sample(n=7)
For either approach above, you can get the rest of the rows by doing:
df_rest = df.loc[~df.index.isin(df_percent.index)]
Per Pedram's comment, if you would like to get reproducible samples, pass the random_state parameter.
df_percent = df.sample(frac=0.7, random_state=42)
ACCEPTED ANSWER
Score 72
Something like this?
import random
def some(x, n):
return x.ix[random.sample(x.index, n)]
Note: As of Pandas v0.20.0, ix has been deprecated in favour of loc for label based indexing.
ANSWER 3
Score 12
The best way to do this is with the sample function from the random module,
import numpy as np
import pandas as pd
from random import sample
# given data frame df
# create random index
rindex = np.array(sample(xrange(len(df)), 10))
# get 10 random rows from df
dfr = df.ix[rindex]
ANSWER 4
Score 5
Below line will randomly select n number of rows out of the total existing row numbers from the dataframe df without replacement.
df = df.take(np.random.permutation(len(df))[:n])