reading json files from s3 to glue pyspark with glueContext.read.json gives wrong result

Does anyone know why glueContext.read.json gives me a wrong result? Basically the below 2 methods give me very different results. After exploding, df2 has much fewer records than df1. anyone had experienced the same? Thanks!! df1 = glueContext.create_dynamic_frame_from_options(“s3″, format=”json”, connection_options = {“paths”: [“s3://…/”]}) df2 = glueContext.read.json(“s3://…/”,multiLine=True)

Details

Validator for ListView Selection Model?

I’m trying to make it so a selection is required in order to proceed and I am wondering if it is possible to achieve this using the ControlsFX Validator and ValidationSupport. public static void test(ValidationSupport support, ListView listView) { Validator<ObservableListWrapper> validator = (control, value) -> { boolean condition = listView.getSelectionModel().getSelectedItem() == null; return ValidationResult.fromMessageIf(control, “Please…

Details

How to to add stacked bar plot hatching in pandas? (…or how to get BarContainer vs AxisSubplot in pandas plot vs. matplotlib?)

I have a code example using matplotlib.pyplot.plot() that works and that that I want to replicate to make hatched bar segments on a stacked bar chart. However, I have been making all of my other graphics using pandas.DataFrame.plot() instead of matplotlib.pyplot.plot() and would like to continue this here as well. The example code returns a…

Details