Challenges and Opportunities in Integrated Space Terrestrial Internet of Things. Large geographical regions and communities remain uncovered by terrestrial network connections. To enable access equality, near Earth orbit satellites will play a defining role in providing Internet of Things (IoT) connectivity on a world wide scale in a flexible and cost effective manner. This paper presents the opportunities arising from global IoT solutions based on space assets, as well as the key research challenges to be addressed. In particular, we discuss existing space and terrestrial IoT technologies and protocols, and the requirements that they need to meet to successfully materialize satellite IoT services. We also propose a novel network architecture to be used by NB IoT and LoRaWAN technologies for implementing future space terrestrial integrated IoT networks.


Discriminative Similarity for Data Clustering. Similarity based clustering methods separate data into clusters according to the pairwise similarity between the data, and the pairwise similarity is crucial for their performance. In this paper, we propose em Clustering by Discriminative Similarity (CDS) , a novel method which learns discriminative similarity for data clustering. CDS learns an unsupervised similarity based classifier from each data partition, and searches for the optimal partition of the data by minimizing the generalization error of the learnt classifiers associated with the data partitions. By generalization analysis via Rademacher complexity, the generalization error bound for the unsupervised similarity based classifier is expressed as the sum of discriminative similarity between the data from different classes. It is proved that the derived discriminative similarity can also be induced by the integrated squared error bound for kernel density classification. In order to evaluate the performance of the proposed discriminative similarity, we propose a new clustering method using a kernel as the similarity function, CDS via unsupervised kernel classification (CDSK), with its effectiveness demonstrated by experimental results.


Ranking Online Social Users by their Influence. We introduce an original mathematical model to analyse the diffusion of posts within a generic online social platform. The main novelty is that each user is not simply considered as a node on the social graph, but is further equipped with his her own Wall and Newsfeed, and has his her own individual self posting and re posting activity. As a main result using our developed model, we derive in closed form the probabilities that posts originating from a given user are found on the Wall and Newsfeed of any other. These are the solution of a linear system of equations, which can be resolved iteratively. In fact, our model is very flexible with respect to the modelling assumptions. Using the probabilities derived from the solution, we define a new measure of per user influence over the entire network, the Psi score, which combines the user position on the graph with user (re )posting activity. In the homogeneous case where all users have the same activity rates, it is shown that a variant of the Psi score is equal to PageRank. Furthermore, we compare the new model and its Psi score against the empirical influence measured from very large data traces (Twitter, Weibo). The results illustrate that these new tools can accurately rank influencers with asymmetric (re )posting activity for such real world applications.


Hierarchical RNNs Based Transformers MADDPG for Mixed Cooperative Competitive Environments. At present, attention mechanism has been widely applied to the fields of deep learning models. Structural models that based on attention mechanism can not only record the relationships between features position, but also can measure the importance of different features based on their weights. By establishing dynamically weighted parameters for choosing relevant and irrelevant features, the key information can be strengthened, and the irrelevant information can be weakened. Therefore, the efficiency of deep learning algorithms can be significantly elevated and improved. Although transformers have been performed very well in many fields including reinforcement learning, there are still many problems and applications can be solved and made with transformers within this area. MARL (known as Multi Agent Reinforcement Learning) can be recognized as a set of independent agents trying to adapt and learn through their way to reach the goal. In order to emphasize the relationship between each MDP decision in a certain time period, we applied the hierarchical coding method and validated the effectiveness of this method. This paper proposed a hierarchical transformers MADDPG based on RNN which we call it Hierarchical RNNs Based Transformers MADDPG(HRTMADDPG). It consists of a lower level encoder based on RNNs that encodes multiple step sizes in each time sequence, and it also consists of an upper sequence level encoder based on transformer for learning the correlations between multiple sequences so that we can capture the causal relationship between sub time sequences and make HRTMADDPG more efficient.


A Robust Blockchain Readiness Index Model. As the blockchain ecosystem gets more mature many businesses, investors, and entrepreneurs are seeking opportunities on working with blockchain systems and cryptocurrencies. A critical challenge for these actors is to identify the most suitable environment to start or evolve their businesses. In general, the question is to identify which countries are offering the most suitable conditions to host their blockchain based activities and implement their innovative projects. The Blockchain Readiness Index (BRI) provides a numerical metric (referred to as the blockchain readiness score) in measuring the maturity readiness levels of a country in adopting blockchain and cryptocurrencies. In doing so, BRI leverages on techniques from information retrieval to algorithmically derive an index ranking for a set of countries. The index considers a range of indicators organized under five pillars Government Regulation, Research, Technology, Industry, and User Engagement. In this paper, we further extent BRI with the capability of deriving the index at the country level even in the presence of missing information for the indicators. In doing so, we are proposing two weighting schemes namely, linear and sigmoid weighting for refining the initial estimates for the indicator values. A classification framework was employed to evaluate the effectiveness of the developed techniques which yielded to a significant classification accuracy.


Equation of State Manhattan Project Developments and Beyond. The hydrodynamic response of materials under extreme conditions of pressure, temperature and strain is dependent on the equation of state of the matter in all its states of existence. The Trinity plutonium implosion device development required the Los Alamos research community to advance the understanding of equations of state further and faster than ever before. The unpredicted high yield from the Trinity fission device explosion and the push to design the "Super" thermonuclear device initiated 75 years of unprecedented research and technological progress in equation of state development. This article describes the progress made on equation of state development during and since the Manhattan Project at Los Alamos.


The Perron non backtracking eigenvalue after node addition. Consider a finite undirected unweighted graph G and add a new node to it arbitrarily connecting it to pre existing nodes. We study the behavior of the Perron eigenvalue of the non backtracking matrix of G before and after such a node addition. We prove an interlacing type result for said eigenvalue, namely, the Perron eigenvalue never decreases after node addition. Furthermore, our methods lead to bounds for the difference between the eigenvalue before and after node addition. These are the first known bounds that have been established in full rigor. Our results depend on the assumption of diagonalizability of the non backtracking matrix. Practical experience says that this assumption is fairly mild in many families of graphs, though necessary and sufficient conditions for it remain an open question.


Existence in the nonlinear Schr "odinger equation with bounded magnetic field. The paper studies existence of ground states for the nonlinear Schr "odinger equation with a general external magnetic field. In particular, no lattice periodicity or symmetry of the magnetic field, or presence of external electric field is required.


Reconsidering Tweets Intervening During Tweet Creation Decreases Offensive Content. The proliferation of harmful and offensive content is a problem that many online platforms face today. One of the most common approaches for moderating offensive content online is via the identification and removal after it has been posted, increasingly assisted by machine learning algorithms. More recently, platforms have begun employing moderation approaches which seek to intervene prior to offensive content being posted. In this paper, we conduct an online randomized controlled experiment on Twitter to evaluate a new intervention that aims to encourage participants to reconsider their offensive content and, ultimately, seeks to reduce the amount of offensive content on the platform. The intervention prompts users who are about to post harmful content with an opportunity to pause and reconsider their Tweet. We find that users in our treatment prompted with this intervention posted 6 fewer offensive Tweets than non prompted users in our control. This decrease in the creation of offensive content can be attributed not just to the deletion and revision of prompted Tweets we also observed a decrease in both the number of offensive Tweets that prompted users create in the future and the number of offensive replies to prompted Tweets. We conclude that interventions allowing users to reconsider their comments can be an effective mechanism for reducing offensive content online.


The Importance of Open Data Policy to Tackle Pandemic in Latin America. Open Data Policies can provide transparency, impulse innovation and citizenship participation. Access to the right data in right time can produce huge benefits to population. But, in Latin America there is not enough interest from governments to promote and use properly. By the other hand, global pandemic has caused many damages in different levels, i.e. Economy, Public Health, Education, etc. The paper opens a discussion about the importance of Open Data Policy to mitigate the impact of Covid 19 and overpass this problem.


Causal Sufficiency and Actual Causation. Pearl opened the door to formally defining actual causation using causal models. His approach rests on two strategies first, capturing the widespread intuition that X x causes Y y iff X x is a Necessary Element of a Sufficient Set for Y y, and second, showing that his definition gives intuitive answers on a wide set of problem cases. This inspired dozens of variations of his definition of actual causation, the most prominent of which are due to Halpern Pearl. Yet all of them ignore Pearl's first strategy, and the second strategy taken by itself is unable to deliver a consensus. This paper offers a way out by going back to the first strategy it offers six formal definitions of causal sufficiency and two interpretations of necessity. Combining the two gives twelve new definitions of actual causation. Several interesting results about these definitions and their relation to the various Halpern Pearl definitions are presented. Afterwards the second strategy is evaluated as well. In order to maximize neutrality, the paper relies mostly on the examples and intuitions of Halpern Pearl. One definition comes out as being superior to all others, and is therefore suggested as a new definition of actual causation.


Intelligent Reflecting Surface assisted MU MISO Systems with Imperfect Hardware Channel Estimation, Beamforming Design. Most works in IRS assisted systems have ignored the impact of the inevitable residual hardware impairments (HWIs) at both the transceiver hardware and the IRS while any relevant works have addressed only simple scenarios, e.g., with single antenna network nodes and or without taking the randomness of phase noise at the IRS into account. In this work, we aim at filling up this gap by considering a general IRS assisted multi user (MU) multiple input single output (MISO) system with imperfect CSI and correlated Rayleigh fading. In parallel, we present a general computationally efficient methodology for IRS reflect beamforming (RB) optimization. Specifically, we introduce an advantageous channel estimation (CE) method for such systems accounting for the HWIs. Moreover, we derive the uplink achievable spectral efficiency (SE) with maximal ratio combining (MRC) receiver, displaying three significant advantages being 1) its closed form expression, 2) its dependence only on large scale statistics, and 3) its low training overhead. Notably, by exploiting the first two benefits, we achieve to perform optimization with respect to the reflect beamforming matrix (RBM) that can take place only at every several coherence intervals, and thus, reduces significantly the computational cost compared to other methods which require frequent phase optimization. Among the insightful observations, we highlight that uncorrelated Rayleigh fading does not allow optimization of the SE, which makes the application of an IRS ineffective. Also, in the case that the phase drifts, describing the distortion of the phases in the RBM, are uniformly distributed, the presence of an IRS provides no advantage. The analytical results outperform previous works and are verified by Monte Carlo (MC) simulations.


Can Question Generation Debias Question Answering Models? A Case Study on Question Context Lexical Overlap. Question answering (QA) models for reading comprehension have been demonstrated to exploit unintended dataset biases such as question context lexical overlap. This hinders QA models from generalizing to under represented samples such as questions with low lexical overlap. Question generation (QG), a method for augmenting QA datasets, can be a solution for such performance degradation if QG can properly debias QA datasets. However, we discover that recent neural QG models are biased towards generating questions with high lexical overlap, which can amplify the dataset bias. Moreover, our analysis reveals that data augmentation with these QG models frequently impairs the performance on questions with low lexical overlap, while improving that on questions with high lexical overlap. To address this problem, we use a synonym replacement based approach to augment questions with low lexical overlap. We demonstrate that the proposed data augmentation approach is simple yet effective to mitigate the degradation problem with only 70k synthetic examples. Our data is publicly available at https github.com KazutoshiShinoda Synonym Replacement.


SOCluster Towards Intent based Clustering of Stack Overflow Questions using Graph Based Approach. Stack Overflow (SO) platform has a huge dataset of questions and answers driven by interactions between users. But the count of unanswered questions is continuously rising. This issue is common across various community Question Answering platforms (Q A) such as Yahoo, Quora and so on. Clustering is one of the approaches used by these communities to address this challenge. Specifically, Intent based clustering could be leveraged to answer unanswered questions using other answered questions in the same cluster and can also improve the response time for new questions. It is here, we propose SOCluster, an approach and a tool to cluster SO questions based on intent using a graph based clustering approach. We selected four datasets of 10k, 20k, 30k 40k SO questions without code snippets or images involved, and performed intent based clustering on them. We have done a preliminary evaluation of our tool by analyzing the resultant clusters using the commonly used metrics of Silhouette coefficient, Calinkski Harabasz Index, Davies Bouldin Index. We performed clustering for 8 different threshold similarity values and analyzed the intriguing trends reflected by the output clusters through the three evaluation metrics. At 90 threshold similarity, it shows the best value for the three evaluation metrics on all four datasets. The source code and tool are available for download on Github at https github.com Liveitabhi SOCluster, and the demo can be found here https youtu.be uyn8ie4h3NY.


HSR Hyperbolic Social Recommender. With the prevalence of online social media, users' social connections have been widely studied and utilized to enhance the performance of recommender systems. In this paper, we explore the use of hyperbolic geometry for social recommendation. We present Hyperbolic Social Recommender (HSR), a novel social recommendation framework that utilizes hyperbolic geometry to boost the performance. With the help of hyperbolic spaces, HSR can learn high quality user and item representations for better modeling user item interaction and user user social relations. Via a series of extensive experiments, we show that our proposed HSR outperforms its Euclidean counterpart and state of the art social recommenders in click through rate prediction and top K recommendation, demonstrating the effectiveness of social recommendation in the hyperbolic space.


Optimal Transmit Beamforming for Integrated Sensing and Communication. This paper studies the transmit beamforming in a downlink integrated sensing and communication (ISAC) system, where a base station (BS) equipped with a uniform linear array (ULA) sends combined information bearing and dedicated radar signals to simultaneously perform downlink multiuser communication and radar target sensing. Under this setup, we maximize the radar sensing performance (in terms of minimizing the beampattern matching errors or maximizing the minimum weighted beampattern gains), subject to the communication users' minimum signal to interference plus noise ratio (SINR) requirements and the BS's transmit power constraints. In particular, we consider two types of communication receivers, namely Type I and Type II receivers, which do not have and do have the capability of cancelling the interference from the emph a priori known dedicated radar signals, respectively. Under both Type I and Type II receivers, the beampattern matching and minimum weighted beampattern gain maximization problems are globally optimally solved via applying the semidefinite relaxation (SDR) technique together with the rigorous proof of the tightness of SDR for both Type I and Type II receivers under the two design criteria. It is shown that at the optimality, radar signals are not required with Type I receivers under some specific conditions, while radar signals are always needed to enhance the performance with Type II receivers. Numerical results show that the minimum weighted beampattern gain maximization leads to significantly higher beampattern gains at the worst case sensing angles with a much lower computational complexity than the beampattern matching design. We show that by exploiting the capability of canceling the interference caused by the radar signals, the case with Type II receivers results in better sensing performance than that with Type I receivers and other conventional designs.


Mod p local global compatibility for mathrm GSp 4( mathbb Q p) in the ordinary case. Let F be a totally real field of even degree in which p splits completely. Let overline r G F rightarrow mathrm GSp 4( overline mathbb F p) be a modular Galois representation unramified at all finite places away from p and upper triangular, maximally nonsplit, and of parallel weight at places dividing p . Fix a place w dividing p . Assuming certain genericity conditions and Taylor Wiles assumptions, we prove that the mathrm GSp 4(F w) action on the corresponding Hecke isotypic part of the space of mod p automorphic forms on a compact mod center form of mathrm GSp 4 with infinite level at w determines overline r G F w .


A platform for cognitive monitoring of neurosurgical patients during hospitalization. Intracranial recordings in epilepsy patients are increasingly utilized to gain insight into the electrophysiological mechanisms of human cognition. There are currently several practical limitations to conducting research with these patients, including patient and researcher availability and the cognitive abilities of patients, which limit the amount of task related data that can be collected. Prior studies have synchronized clinical audio, video, and neural recordings to understand naturalistic behaviors, but these recordings are centered on the patient to understand their seizure semiology and thus do not capture and synchronize audiovisual stimuli from tasks. Here, we describe a platform for cognitive monitoring of neurosurgical patients during their hospitalization that benefits both patients and researchers alike. We provide the full specifications for this system and describe some example use cases in perception, memory, and sleep research. Our system opens up new avenues to collect more data per patient using real world tasks, affording new possibilities to conduct longitudinal studies of the electrophysiological basis of human cognition under naturalistic conditions.


Representation of measures of noncompactness and its applications related to an initial value problem in Banach spaces. The purpose of this paper is devoted to studying representation of measures of non generalized compactness, in particular, measures of noncompactness, of non weak compactness, and of non super weak compactness, etc, defined on Banach spaces and its applications. With the aid of a three time order preserving embedding theorem, we show that for every Banach space X , there exist a Banach function space C(K) for some compact Hausdorff space K , and an order preserving affine mapping mathbb T from the super space mathscr B of all nonempty bounded subsets of X endowed with the Hausdorff metric to the positive cone C(K) of C(K) such that for every convex measure, in particular, regular measure, homogeneous measure, sublinear measure of non generalized compactness mu on X , there is a convex function digamma on the cone V mathbb T( mathscr B) which is Lipschitzian on each bounded set of V such that digamma( mathbb T(B)) mu(B), forall B in mathscr B. As its applications, we show a class of basic integral inequalities related to an initial value problem in Banach spaces, and prove a solvability result of the initial value problem, which is an extension of some classical results due to Goebel, Rzymowski, and Bana ' s .


FinQA A Dataset of Numerical Reasoning over Financial Data. The sheer volume of financial statements makes it difficult for humans to access and analyze a business's financials. Robust numerical reasoning likewise faces unique challenges in this domain. In this work, we focus on answering deep questions over financial data, aiming to automate the analysis of a large corpus of financial documents. In contrast to existing tasks on general domain, the finance domain includes complex numerical reasoning and understanding of heterogeneous representations. To facilitate analytical progress, we propose a new large scale dataset, FinQA, with Question Answering pairs over Financial reports, written by financial experts. We also annotate the gold reasoning programs to ensure full explainability. We further introduce baselines and conduct comprehensive experiments in our dataset. The results demonstrate that popular, large, pre trained models fall far short of expert humans in acquiring finance knowledge and in complex multi step numerical reasoning on that knowledge. Our dataset the first of its kind should therefore enable significant, new community research into complex application domains. The dataset and code are publicly available url https github.com czyssrs FinQA .


Two stage Deep Stacked Autoencoder with Shallow Learning for Network Intrusion Detection System. Sparse events, such as malign attacks in real time network traffic, have caused big organisations an immense hike in revenue loss. This is due to the excessive growth of the network and its exposure to a plethora of people. The standard methods used to detect intrusions are not promising and have significant failure to identify new malware. Moreover, the challenges in handling high volume data with sparsity, high false positives, fewer detection rates in minor class, training time and feature engineering of the dimensionality of data has promoted deep learning to take over the task with less time and great results. The existing system needs improvement in solving real time network traffic issues along with feature engineering. Our proposed work overcomes these challenges by giving promising results using deep stacked autoencoders in two stages. The two stage deep learning combines with shallow learning using the random forest for classification in the second stage. This made the model get well with the latest Canadian Institute for Cybersecurity Intrusion Detection System 2017 (CICIDS 2017) dataset. Zero false positives with admirable detection accuracy were achieved.


DASVDD Deep Autoencoding Support Vector Data Descriptor for Anomaly Detection. Semi supervised anomaly detection aims to detect anomalies from normal samples using a model that is trained on normal data. With recent advancements in deep learning, researchers have designed efficient deep anomaly detection methods. Existing works commonly use neural networks to map the data into a more informative representation and then apply an anomaly detection algorithm. In this paper, we propose a method, DASVDD, that jointly learns the parameters of an autoencoder while minimizing the volume of an enclosing hyper sphere on its latent representation. We propose an anomaly score which is a combination of autoencoder's reconstruction error and the distance from the center of the enclosing hypersphere in the latent representation. Minimizing this anomaly score aids us in learning the underlying distribution of the normal class during training. Including the reconstruction error in the anomaly score ensures that DASVDD does not suffer from the common hypersphere collapse issue since the DASVDD model does not converge to the trivial solution of mapping all inputs to a constant point in the latent representation. Experimental evaluations on several benchmark datasets show that the proposed method outperforms the commonly used state of the art anomaly detection algorithms while maintaining robust performance across different anomaly classes.


Abelian subalgebras and ideals of maximal dimension in Leibniz algebras. In this paper, we compare the abelian subalgebras and ideals of maximal dimension for finite dimensional Leibniz algebras. We study Leibniz algebras containing abelian subalgebras of codimension 1, solvable and supersolvable Leibniz algebras for codimensions 1 and 2, nilpotent Leibniz algebras in case of codimension 2 and we also analyze the case of k abelian p filiform Leibniz algebras. Throughout the paper, we also give examples to clarify some results and the need for restrictions on the underlying field.


Neural Symbolic Integration for Interactive Learning and Conceptual Grounding. We propose neural symbolic integration for abstract concept explanation and interactive learning. Neural symbolic integration and explanation allow users and domain experts to learn about the data driven decision making process of large neural models. The models are queried using a symbolic logic language. Interaction with the user then confirms or rejects a revision of the neural model using logic based constraints that can be distilled into the model architecture. The approach is illustrated using the Logic Tensor Network framework alongside Concept Activation Vectors and applied to a Convolutional Neural Network.


A Primal Dual Approach to Constrained Markov Decision Processes. In many operations management problems, we need to make decisions sequentially to minimize the cost while satisfying certain constraints. One modeling approach to study such problems is constrained Markov decision process (CMDP). When solving the CMDP to derive good operational policies, there are two key challenges one is the prohibitively large state space and action space the other is the hard to compute transition kernel. In this work, we develop a sampling based primal dual algorithm to solve CMDPs. Our approach alternatively applies regularized policy iteration to improve the policy and subgradient ascent to maintain the constraints. Under mild regularity conditions, we show that the algorithm converges at rate O( log(T) sqrt T ) , where T is the number of iterations. When the CMDP has a weakly coupled structure, our approach can substantially reduce the dimension of the problem through an embedded decomposition. We apply the algorithm to two important applications with weakly coupled structures multi product inventory management and multi class queue scheduling, and show that it generates controls that outperform state of art heuristics.


Analysis of intensity correlation enhanced plasmonic structured illumination microscopy. We propose to enhance the performance of localized plasmon structured illumination microscopy (LP SIM) via intensity correlations. LP SIM uses sub wavelength illumination patterns to encode high spatial frequency information. It can enhance the resolution up to three fold before gaps in the OTF support arise. For blinking fluorophores or for quantum antibunching an intensity correlation analysis induces higher harmonics of the illumination pattern and enlarges the effective OTF. This enables ultrahigh resolutions without gaps in the OTF support, and thus a fully deterministic imaging scheme. We present simulations that include shot and external noise and demonstrate the resolution power under realistic photon budgets. The technique has potential in light microscopy where low intensity illumination is paramount while aiming for high spatial but moderate temporal resolutions.


Data Protection Impact Assessment for the Corona App. Since SARS CoV 2 started spreading in Europe in early 2020, there has been a strong call for technical solutions to combat or contain the pandemic, with contact tracing apps at the heart of the debates. The EU's General Daten Protection Regulation (GDPR) requires controllers to carry out a data protection impact assessment (DPIA) where their data processing is likely to result in a high risk to the rights and freedoms (Art. 35 GDPR). A DPIA is a structured risk analysis that identifies and evaluates possible consequences of data processing relevant to fundamental rights and describes the measures envisaged to address these risks or expresses the inability to do so. Based on the Standard Data Protection Model (SDM), we present a scientific DPIA which thoroughly examines three published contact tracing app designs that are considered to be the most "privacy friendly" PEPP PT, DP 3T and a concept summarized by Chaos Computer Club member Linus Neumann, all of which process personal health data. The DPIA starts with an analysis of the processing context and some expected use cases. Then, the processing activities are described by defining a realistic processing purpose. This is followed by the legal assessment and threshold analysis. Finally, we analyse the weak points, the risks and determine appropriate protective measures. We show that even decentralized implementations involve numerous serious weaknesses and risks. Legally, consent is unfit as legal ground hence data must be processed based on a law. We also found that measures to realize the rights of data subjects and affected people are not sufficient. Last but not least, we show that anonymization must be understood as a continuous process, which aims at separating the personal reference and is based on a mix of legal, organizational and technical measures. All currently available proposals lack such an explicit separation process.


Enhancing the impedance matched bandwidth of bottle microresonator signal processing devices. Light pulses entering an elongated bottle microresonator (BMR) from a transversely oriented input output waveguide (microfiber) slowly propagate along the BMR length and bounce between turning points at its constricting edges. To avoid insertion losses and processing errors, a pulse should completely transfer from the waveguide into the BMR and, after being processed, completely return back into the waveguide. For this purpose, the waveguide and BMR should be impedance matched along the pulse bandwidth. Here we show how to enhance the impedance matched bandwidth by optimization of the BMR effective radius variation in a small vicinity of the input output waveguide.


Face sketch to photo translation using generative adversarial networks. Translating face sketches to photo realistic faces is an interesting and essential task in many applications like law enforcement and the digital entertainment industry. One of the most important challenges of this task is the inherent differences between the sketch and the real image such as the lack of color and details of the skin tissue in the sketch. With the advent of adversarial generative models, an increasing number of methods have been proposed for sketch to image synthesis. However, these models still suffer from limitations such as the large number of paired data required for training, the low resolution of the produced images, or the unrealistic appearance of the generated images. In this paper, we propose a method for converting an input facial sketch to a colorful photo without the need for any paired dataset. To do so, we use a pre trained face photo generating model to synthesize high quality natural face photos and employ an optimization procedure to keep high fidelity to the input sketch. We train a network to map the facial features extracted from the input sketch to a vector in the latent space of the face generating model. Also, we study different optimization criteria and compare the results of the proposed model with those of the state of the art models quantitatively and qualitatively. The proposed model achieved 0.655 in the SSIM index and 97.59 rank 1 face recognition rate with higher quality of the produced images.


Discrete multilinear maximal functions and number theory. Many multilinear discrete operators are primed for pointwise decomposition such decompositions give structural information but also an essentially optimal range of bounds. We study the (continuous) slicing method of Jeong and Lee which when debuted instantly gave sharp multilinear operator bounds in the discrete setting. Via several examples, number theoretic connections, pointed commentary, and a unified theory we hope that this useful technique will lead to further applications. This work generalizes, and was inspired by, the author's work with Palsson on a special case.


physics.comp-ph cs.NA math.NA physics.class-ph

A mimetic discretization of the macroscopic Maxwell equations in Hamiltonian form. A mimetic discretization of the Hamiltonian structure of the macroscopic Maxwell equations with periodic boundary conditions is presented. The model accommodates general (and possibly nonlinear) polarizations and magnetizations. The fields are modeled as either straight or twisted differential forms, so each variable associated with one of the vector spaces in the double de Rham complex. The discretization strategy is an adaptation of the mimetic discretization framework of Bochev and Hyman with special attention given to the Poincar 'e duality structure inherent in the double de Rham complex. The L 2 and Poincar 'e duality pairings induce the Hodge star operator at both the continuous and discrete levels which act as maps between the two de Rham complexes. Additionally, the discrete duality pairings provide a convenient framework for the discretization of variational derivatives. These discretized variational derivatives may then be used as a tool for discretizing the Poisson bracket of the macroscopic Maxwell equations. The discretized macroscopic Maxwell equations possess Hamiltonian structure the use of mimetic spaces and and a natural discretization of the variational derivatives ensure the existence of discrete Casimir invariants of the Maxwell bracket. As a simple test case, a one dimensional version of Maxwell's equations are discretized in the same manner and its computed solutions are given.


Do Not Escape From the Manifold Discovering the Local Coordinates on the Latent Space of GANs. The discovery of the disentanglement properties of the latent space in GANs motivated a lot of research to find the semantically meaningful directions on it. In this paper, we suggest that the disentanglement property is closely related to the geometry of the latent space. In this regard, we propose an unsupervised method for finding the semantic factorizing directions on the intermediate latent space of GANs based on the local geometry. Intuitively, our proposed method, called Local Basis, finds the principal variation of the latent space in the neighborhood of the base latent variable. Experimental results show that the local principal variation corresponds to the semantic factorization and traversing along it provides strong robustness to image traversal. Moreover, we suggest an explanation for the limited success in finding the global traversal directions in the latent space, especially W space of StyleGAN2. We show that W space is warped globally by comparing the local geometry, discovered from Local Basis, through the metric on Grassmannian Manifold. The global warpage implies that the latent space is not well aligned globally and therefore the global traversal directions are bound to show limited success on it.


When Does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning?. Contrastive learning (CL) can learn generalizable feature representations and achieve the state of the art performance of downstream tasks by finetuning a linear classifier on top of it. However, as adversarial robustness becomes vital in image classification, it remains unclear whether or not CL is able to preserve robustness to downstream tasks. The main challenge is that in the self supervised pretraining supervised finetuning paradigm, adversarial robustness is easily forgotten due to a learning task mismatch from pretraining to finetuning. We call such a challenge 'cross task robustness transferability'. To address the above problem, in this paper we revisit and advance CL principles through the lens of robustness enhancement. We show that (1) the design of contrastive views matters High frequency components of images are beneficial to improving model robustness (2) Augmenting CL with pseudo supervision stimulus (e.g., resorting to feature clustering) helps preserve robustness without forgetting. Equipped with our new designs, we propose AdvCL, a novel adversarial contrastive pretraining framework. We show that AdvCL is able to enhance cross task robustness transferability without loss of model accuracy and finetuning efficiency. With a thorough experimental study, we demonstrate that AdvCL outperforms the state of the art self supervised robust learning methods across multiple datasets (CIFAR 10, CIFAR 100, and STL 10) and finetuning schemes (linear evaluation and full model finetuning).


Physics of complex systems Discovery in the age of Goedel. From the perspective of the physics of complex systems (1) we deal with the current state of mod ern physics including the crisis in physics demonstrated through its epistemological, psychological, economical as well as the social context (2) considering the strength of the Goedel s Incompleteness Theorems we point out the following open questions in physics (i) the limits of the precision of certainty, (ii) the limits of making decisions on information and (iii) the limitations of reasoning that sometimes affect progress, (3) since further advances will necessarily require synergy between physics and seemingly distinct fields mathematics, information science, chemistry, biology, medicine, psychology, and art. We illustrate this relation by providing examples based on our research. Point (1) is discussed in Ch1 while Ch2 Ch5 encompasses the point (2) and point (3) is covered in Ch6 Ch10.


PV RCNN Point Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detection. 3D object detection is receiving increasing attention from both industry and academia thanks to its wide applications in various fields. In this paper, we propose the Point Voxel Region based Convolution Neural Networks (PV RCNNs) for 3D object detection from point clouds. First, we propose a novel 3D detector, PV RCNN, which consists of two steps the voxel to keypoint scene encoding and keypoint to grid RoI feature abstraction. These two steps deeply integrate the 3D voxel CNN with the PointNet based set abstraction for extracting discriminative features. Second, we propose an advanced framework, PV RCNN , for more efficient and accurate 3D object detection. It consists of two major improvements the sectorized proposal centric strategy for efficiently producing more representative keypoints, and the VectorPool aggregation for better aggregating local point features with much less resource consumption. With these two strategies, our PV RCNN is more than 2x faster than PV RCNN, while also achieving better performance on the large scale Waymo Open Dataset with 150m 150m detection range. Also, our proposed PV RCNNs achieve state of the art 3D detection performance on both the Waymo Open Dataset and the highly competitive KITTI benchmark. The source code is available at https github.com open mmlab OpenPCDet.


Recent Advances in Automated Question Answering In Biomedical Domain. The objective of automated Question Answering (QA) systems is to provide answers to user queries in a time efficient manner. The answers are usually found in either databases (or knowledge bases) or a collection of documents commonly referred to as the corpus. In the past few decades there has been a proliferation of acquisition of knowledge and consequently there has been an exponential growth in new scientific articles in the field of biomedicine. Therefore, it has become difficult to keep track of all the information in the domain, even for domain experts. With the improvements in commercial search engines, users can type in their queries and get a small set of documents most relevant for answering their query, as well as relevant snippets from the documents in some cases. However, it may be still tedious and time consuming to manually look for the required information or answers. This has necessitated the development of efficient QA systems which aim to find exact and precise answers to user provided natural language questions in the domain of biomedicine. In this paper, we introduce the basic methodologies used for developing general domain QA systems, followed by a thorough investigation of different aspects of biomedical QA systems, including benchmark datasets and several proposed approaches, both using structured databases and collection of texts. We also explore the limitations of current systems and explore potential avenues for further advancement.


Multiple Support Recovery Using Very Few Measurements Per Sample. In the problem of multiple support recovery, we are given access to linear measurements of multiple sparse samples in mathbb R d . These samples can be partitioned into ell groups, with samples having the same support belonging to the same group. For a given budget of m measurements per sample, the goal is to recover the ell underlying supports, in the absence of the knowledge of group labels. We study this problem with a focus on the measurement constrained regime where m is smaller than the support size k of each sample. We design a two step procedure that estimates the union of the underlying supports first, and then uses a spectral algorithm to estimate the individual supports. Our proposed estimator can recover the supports with m k measurements per sample, from tilde O (k 4 ell 4 m 4 ) samples. Our guarantees hold for a general, generative model assumption on the samples and measurement matrices. We also provide results from experiments conducted on synthetic data and on the MNIST dataset.


Look, Cast and Mold Learning 3D Shape Manifold from Single view Synthetic Data. Inferring the stereo structure of objects in the real world is a challenging yet practical task. To equip deep models with this ability usually requires abundant 3D supervision which is hard to acquire. It is promising that we can simply benefit from synthetic data, where pairwise ground truth is easy to access. Nevertheless, the domain gaps are nontrivial considering the variant texture, shape and context. To overcome these difficulties, we propose a Visio Perceptual Adaptive Network for single view 3D reconstruction, dubbed VPAN. To generalize the model towards a real scenario, we propose to fulfill several aspects (1) Look visually incorporate spatial structure from the single view to enhance the expressiveness of representation (2) Cast perceptually align the 2D image features to the 3D shape priors with cross modal semantic contrastive mapping (3) Mold reconstruct stereo shape of target by transforming embeddings into the desired manifold. Extensive experiments on several benchmarks demonstrate the effectiveness and robustness of the proposed method in learning the 3D shape manifold from synthetic data via a single view. The proposed method outperforms state of the arts on Pix3D dataset with IoU 0.292 and CD 0.108, and reaches IoU 0.329 and CD 0.104 on Pascal 3D .


NViT Vision Transformer Compression and Parameter Redistribution. Transformers yield state of the art results across many tasks. However, they still impose huge computational costs during inference. We apply global, structural pruning with latency aware regularization on all parameters of the Vision Transformer (ViT) model for latency reduction. Furthermore, we analyze the pruned architectures and find interesting regularities in the final weight structure. Our discovered insights lead to a new architecture called NViT (Novel ViT), with a redistribution of where parameters are used. This architecture utilizes parameters more efficiently and enables control of the latency accuracy trade off. On ImageNet 1K, we prune the DEIT Base (Touvron et al., 2021) model to a 2.6x FLOPs reduction, 5.1x parameter reduction, and 1.9x run time speedup with only 0.07 loss in accuracy. We achieve more than 1 accuracy gain when compressing the base model to the throughput of the Small Tiny variants. NViT gains 0.1 1.1 accuracy over the hand designed DEIT family when trained from scratch, while being faster.


Early Stages of Flame Propagation in Tubes with No slip Walls and the Mechanism of Tulip Flame Formation. The early stages of flames propagation in tubes with no slip walls and the inversion of the flame front from a convex shape directed towards unburned gas to a concave shape with a cusp directed to the burned gas, known as a tulip flame, was investigated for closed and half open tubes by solving the fully compressible reactive Navier Stokes equations with a one step Arrhenius chemical model for the highly reactive hydrogen air and slowly reacting methane air mixtures. The development of the tulip flame in hydrogen air obtained in simulations with a one step Arrhenius model was compared with simulations using a detailed chemical model. It is shown that the inversion of the flame front and the onset of the tulip flame occurs due to rarefaction waves generated by the decelerating flame when its surface was reduced due to extinguishing of the rear parts of the flame skirt at the sidewalls. The rarefaction waves reduce the flow velocity ahead of the flame, creating an uneven velocity profile, which facilitate the flame front inversion. In the case of a flame propagating in a tube with both ends closed, the compression wave reflected from the tube end opposite to the ignition end, also contribute to the inversion of the flame front. In the case of fast flames and a relatively short tube with both closed ends, the rarefaction waves may invert the flow velocities in the unburned gas towards the propagating flame. The tulip flame formation mechanism is a purely gas dynamic phenomenon not associated with flame instabilities or vortex motion, in agreement with the conclusion obtained in recent experimental studies 1 .


Quantized Neural Networks via 1, 1 Encoding Decomposition and Acceleration. The training of deep neural networks (DNNs) always requires intensive resources for both computation and data storage. Thus, DNNs cannot be efficiently applied to mobile phones and embedded devices, which severely limits their applicability in industrial applications. To address this issue, we propose a novel encoding scheme using 1, 1 to decompose quantized neural networks (QNNs) into multi branch binary networks, which can be efficiently implemented by bitwise operations (i.e., xnor and bitcount) to achieve model compression, computational acceleration, and resource saving. By using our method, users can achieve different encoding precisions arbitrarily according to their requirements and hardware resources. The proposed mechanism is highly suitable for the use of FPGA and ASIC in terms of data storage and computation, which provides a feasible idea for smart chips. We validate the effectiveness of our method on large scale image classification (e.g., ImageNet), object detection, and semantic segmentation tasks. In particular, our method with low bit encoding can still achieve almost the same performance as its high bit counterparts.


Existence and structure of P area minimizing surfaces in the Heisenberg group. We study existence and structure of P area minimizing surfaces in the Heisenberg group under Dirichlet and Neumann boundary conditions. We show that there exists an underlying vector field N that characterized existence and structure of P area minimizing surfaces. This vector field exists even if there is no P area minimizing surface satisfying the prescribed boundary conditions. We prove that if partial Omega satisfies a so called Barrier condition, it is sufficient to guarantee existence of such surfaces. Our approach is completely different from previous methods in the literature and makes major progress in understanding existence of P area minimizing surfaces.


Homeostasis Design and Implementation of a Self Stabilizing Compiler. Mainstream compilers perform a multitude of analyses and optimizations on the given input program. Each analysis pass may generate a program abstraction. Each optimization pass is typically composed of multiple alternating phases of inspection of program abstractions and transformations of the program. Upon transformation of a program, the program abstractions generated by various analysis passes may become inconsistent with the program's modified state. Consequently, the downstream transformations may be considered unsafe until the relevant program abstractions are stabilized, i.e., the program abstractions are made consistent with the modified program. In general, the existing compiler frameworks do not perform automated stabilization of the program abstractions and instead leave it to the optimization writer to deal with the complex task of identifying the relevant program abstractions to stabilize, the points where the stabilization is to be performed, and the exact procedure of stabilization. Similarly, adding new analyses becomes a challenge as one has to understand which all existing optimizations may impact the newly added program abstractions. In this paper, we address these challenges by providing the design and implementation of a novel generalized compiler design framework called Homeostasis. Homeostasis can be used to guarantee the trigger of automated stabilization of relevant program abstractions under every possible transformation of the program. Interestingly, Homeostasis provides such guarantees not only for the existing optimization passes but also for any future optimizations that may be added to the framework. We have implemented our proposed ideas in the IMOP compiler framework, for OpenMP C programs. We present an evaluation which shows that Homeostasis is efficient and easy to use.


Design Thinking and Creativity of Co located vs. Globally Distributed Software Developers. Context Designing software is an activity in which software developers think and make design decisions that shape the structure and behavior of software products. Designing software is one of the least understood software engineering activities. In a collaborative design setting, various types of distances can lead to challenges and effects that potentially affect how software is designed. Objective To contribute to a better understanding of collaborative software design, we investigate how geographic distance affects its design thinking and the creativity of its discussions. Method To this end, we conducted a multiple case study exploring the design thinking and creativity of co located and distributed software developers in a collaborative design setting. Results Compared to co located developers, distributed developers spend less time on exploring the problem space, which could be related to different socio technical challenges, such as lack of awareness and common understanding. Distributed development does not seem to affect the creativity of their activities. Conclusion Developers engaging in collaborative design need to be aware that problem space exploration is reduced in a distributed setting. Unless distributed teams take compensatory measures, this could adversely affect the development. Regarding the effect distance has on creativity, our results are inconclusive and further studies are needed.


From social interactions to private environmental behaviours The case of consumer food waste. Consumer food waste, like many environmental behaviours, takes place in private, and is not directly subject to social monitoring. Nevertheless, social interactions can affect private opinions and behaviours. This paper builds an agent based model of interactions between consumers heterogeneous in their sociability, initial opinions and behaviours related to food waste and willingness to consider different opinions, in order to assess how social interactions can affect private behaviours. Compared to existing models of opinion dynamics, we innovate by including a range of cognitive dissonance'' between stated opinions and actual behaviours that consumers are willing to accept before changing one of the two. We calibrate the model using questionnaire data on household food waste in Italy. We find that a limited degree of mixing between different socio demographic groups, namely adult and young consumers, is enough to trigger change, but a certain openness of mind is required from more wasteful individuals. Equally, a small group of environmentally committed consumers can attract a sizeable share of the population towards low waste behaviours if they show a certain variability of opinions and are willing to compromise with individuals in their close neighbourhood in terms of opinions. These findings can help design effective interventions to promote pro environmental behaviours, taking advantage of the beneficial network effects while anticipating negative externalities.


Reconfigurable Intelligent Surfaces in 6G Reflective, Transmissive, or Both?. Reconfigurable intelligent surfaces (RISs) have attracted wide interest from industry and academia since they can shape the wireless environment into a desirable form with a low cost. In practice, RISs have three types of implementations 1) reflective, where signals can be reflected to the users on the same side of the base station (BS), 2) transmissive, where signals can penetrate the RIS to serve the users on the opposite side of the BS, and 3) hybrid, where the RISs have a dual function of reflection and transmission. However, existing works focus on the reflective type RISs, and the other two types of RISs are not well investigated. In this letter, a downlink multi user RIS assisted communication network is considered, where the RIS can be one of these types. We derive the system sum rate, and discuss which type can yield the best performance under a specific user distribution. Numerical results verify our analysis.


Broadband Omni resonant Coherent Perfect Absorption in Graphene. Coherent perfect absorption (CPA) refers to interferometrically induced complete absorption of incident light by a partial absorber independently of its intrinsic absorption (which may be vanishingly small) or its thickness. CPA is typically realized in a resonant device, and thus cannot be achieved over a broad continuous spectrum, which thwarts its applicability to photodetectors and solar cells, for example. Here, we demonstrate broadband omni resonant CPA by placing a thin weak absorber in a planar cavity and pre conditioning the incident optical field by introducing judicious angular dispersion. We make use of monolayer graphene embedded in silica as the absorber and boost its optical absorption from 1.6 to 60 over a bandwidth of 70 nm in the visible. Crucially, an analytical model demonstrates that placement of the graphene monolayer at a peak in the cavity standing wave field is not necessary to achieve CPA, contrary to conventional wisdom.


Kempe equivalence of 4 critical planar graphs. Answering a question of Mohar from 2007, we show that for every 4 critical planar graph, its set of 4 colorings is a Kempe class.


GAssert A Fully Automated Tool to Improve Assertion Oracles. This demo presents the implementation and usage details of GASSERT, the first tool to automatically improve assertion oracles. Assertion oracles are executable boolean expressions placed inside the program that should pass (return true) for all correct executions and fail (return false) for all incorrect executions. Because designing perfect assertion oracles is difficult, assertions are prone to both false positives (the assertion fails but should pass) and false negatives (the assertion passes but should fail). Given a Java method containing an assertion oracle to improve, GASSERT returns an improved assertion with fewer false positives and false negatives than the initial assertion. Internally, GASSERT implements a novel co evolutionary algorithm that explores the space of possible assertions guided by two fitness functions that reward assertions with fewer false positives, fewer false negatives, and smaller size.


Contrastive Object Detection Using Knowledge Graph Embeddings. Object recognition for the most part has been approached as a one hot problem that treats classes to be discrete and unrelated. Each image region has to be assigned to one member of a set of objects, including a background class, disregarding any similarities in the object types. In this work, we compare the error statistics of the class embeddings learned from a one hot approach with semantically structured embeddings from natural language processing or knowledge graphs that are widely applied in open world object detection. Extensive experimental results on multiple knowledge embeddings as well as distance metrics indicate that knowledge based class representations result in more semantically grounded misclassifications while performing on par compared to one hot methods on the challenging COCO and Cityscapes object detection benchmarks. We generalize our findings to multiple object detection architectures by proposing a knowledge embedded design for keypoint based and transformer based object detection architectures.


Discovery of Layered Software Architecture from Source Code Using Ego Networks. Software architecture refers to the high level abstraction of a system including the configuration of the involved elements and the interactions and relationships that exist between them. Source codes can be easily built by referring to the software architectures. However, the reverse process i.e. derivation of the software architecture from the source code is a challenging task. Further, such an architecture consists of multiple layers, and distributing the existing elements into these layers should be done accurately and efficiently. In this paper, a novel approach is presented for the recovery of layered architectures from Java based software systems using the concept of ego networks. Ego networks have traditionally been used for social network analysis, but in this paper, they are modified in a particular way and tuned to suit the mentioned task. Specifically, a dependency network is extracted from the source code to create an ego network. The ego network is processed to create and optimize ego layers in a particular structure. These ego layers when integrated and optimized together give the final layered architecture. The proposed approach is evaluated in two ways on static versions of three open source software, and a continuously evolving software system. The distribution of nodes amongst the proposed layers and the committed violations are observed on both class level and package level. The proposed method is seen to outperform the existing standard approaches over multiple performance metrics. We also carry out the analysis of variation in the results concerning the change in the node selection strategy and the frequency. The empirical observations show promising signs for recovering software architecture layers from source codes using this technique and also extending it further to other languages and software.


Mirror assisted tuning of laser stabilization via self injection locking to WGM microresonator. Self injection locking is a dynamic phenomenon which provides passive stabilization of a lasers emission frequency via resonant optical feedback. The stabilization coefficient depends on the level of resonant feedback and quality factor of the external resonant structure creating the feedback. Usually a self injection locked laser (SIL) involves barely tunable resonant Rayleigh scattering (RRS). In this work we study theoretically a scheme of a SIL to a high Q microresonator with drop port coupled mirror, in which optical feedback level is optimally adjusted by the tuning the drop port mirror coupling. We show that the additional reflector can improve the laser stabilization and power handling efficiency if compared with the classic RRS based scheme.


QBugs A Collection of Reproducible Bugs in Quantum Algorithms and a Supporting Infrastructure to Enable Controlled Quantum Software Testing and Debugging Experiments. Reproducibility and comparability of empirical results are at the core tenet of the scientific method in any scientific field. To ease reproducibility of empirical studies, several benchmarks in software engineering research, such as Defects4J, have been developed and widely used. For quantum software engineering research, however, no benchmark has been established yet. In this position paper, we propose a new benchmark named QBugs which will provide experimental subjects and an experimental infrastructure to ease the evaluation of new research and the reproducibility of previously published results on quantum software engineering.


Efficient Calling Conventions for Irregular Architectures. We empirically evaluated thousands of different C calling conventions for irregular microcontroller architectures, and found potential for improvement over the calling conventions previously used in the Small Device C Compiler (SDCC). The improvements in code size and speed are substantial enough that SDCC made changes to its default calling convention, breaking ABI compatibility.


Evolution of nonlinear reduced order solutions for PDEs with conserved quantities. Reduced order models of time dependent partial differential equations (PDEs) where the solution is assumed as a linear combination of prescribed modes are rooted in a well developed theory. However, more general models where the reduced solutions depend nonlinearly on time varying parameters have thus far been derived in an ad hoc manner. Here, we introduce Reduced order Nonlinear Solutions (RONS) a unified framework for deriving reduced order models that depend nonlinearly on a set of time dependent parameters. The set of all possible reduced order solutions are viewed as a manifold immersed in the function space of the PDE. The parameters are evolved such that the instantaneous discrepancy between reduced dynamics and the full PDE dynamics is minimized. This results in a set of explicit ordinary differential equations on the tangent bundle of the manifold. In the special case of linear parameter dependence, our reduced equations coincide with the standard Galerkin projection. Furthermore, any number of conserved quantities of the PDE can readily be enforced in our framework. Since RONS does not assume an underlying variational formulation for the PDE, it is applicable to a broad class of problems. We demonstrate the efficacy of RONS on three examples an advection diffusion equation, the nonlinear Schrodinger equation and Euler's equation for ideal fluids.


On limits of betweenness relations. We give a flexible method for constructing a wide variety of limits of betweenness relations. This unifies work of Adeleke, who constructed a Jordan group preserving a limit of betweenness relations, and Bhattacharjee and Macpherson who gave an alternative method using a Fra "ss 'e type construction. A key ingredient in their work is the notion of a tree of B sets. We employ this, and extend its use to a wider class of examples.


Generalizations of Some Concentration Inequalities. For a real valued measurable function f and a nonnegative, nondecreasing function phi , we first obtain a Chebyshev type inequality which provides an upper bound for displaystyle phi( lambda 1 ) mu( x in Omega f(x) geq lambda 1 ) sum k 2 n left( phi( lambda k ) phi( lambda k 1 ) right) mu( x in Omega f(x) geq lambda k ) , where 0 lambda 1 lambda 2 cdots lambda n infty . Using this, generalizations of a few concentration inequalities such as Markov, reverse Markov, Bienaym 'e Chebyshev, Cantelli and Hoeffding inequalities are obtained.


Enhancing Reading Strategies by Exploring A Theme based Approach to Literature Surveys. Searching large digital repositories can be extremely frustrating, as common list based formats encourage users to adopt a convenience sampling approach that favours chance discovery and random search, over meaningful exploration. We have designed a methodology that allows users to visually and thematically explore corpora, while developing personalised holistic reading strategies. We describe the results of a three phase qualitative study, in which experienced researchers used our interactive visualisation approach to analyse a set of publications and select relevant themes and papers. Using in depth semi structured interviews and stimulated recall, we found that users (i) selected papers that they otherwise would not have read, (ii) developed a more coherent reading strategy, and (iii) understood the thematic structure and relationships between papers more effectively. Finally, we make six design recommendations to enhance current digital repositories that we have shown encourage users to adopt a more holistic and thematic research approach.


Pull Request Latency Explained An Empirical Overview. Pull request latency evaluation is an essential application of effort evaluation in the pull based development scenario. It can help the reviewers sort the pull request queue, remind developers about the review processing time, speed up the review process and accelerate software development. There is a lack of work that systematically organizes the factors that affect pull request latency. Also, there is no related work discussing the differences and variations in characteristics in different scenarios and contexts. In this paper, we collected relevant factors through a literature review approach. Then we assessed their relative importance in five scenarios and six different contexts using the mixed effects linear regression model. We find that the relative importance of factors differs in different scenarios, e.g., the first response time of the reviewer is most important when there exist comments. Meanwhile, the number of commits in a pull request has a more significant impact on pull request latency when closing than submitting due to changes in contributions brought about by the review process.


Special cases and equivalent forms of Katznelson's problem on recurrence. We make three observations regarding a question popularized by Katznelson is every subset of mathbb Z which is a set of Bohr recurrence is also set of topological recurrence? (i) If G is a countable abelian group and E subset G is an I 0 set, then every subset of E E which is a set of Bohr recurrence is also a set of topological recurrence. In particular every subset of 2 n 2 m n,m in mathbb N which is a set of Bohr recurrence is a set of topological recurrence. (ii) Let mathbb Z omega be the direct sum of countably many copies of mathbb Z with standard basis E . If every subset of (E E) (E E) which is a set of Bohr recurrence is also a set of topological recurrence, then every subset of every countable abelian group which is a set of Bohr recurrence is also a set of topological recurrence. (iii) Fix a prime p and let mathbb F p omega be the direct sum of countably many copies of mathbb Z p mathbb Z with basis ( mathbf e i) i in mathbb N . If for every p uniform hypergraph with vertex set mathbb N and edge set mathcal F having infinite chromatic number, the Cayley graph on mathbb F p omega determined by sum i in F mathbf e i F in mathcal F has infinite chromatic number, then every subset of mathbb F p omega which is a set of Bohr recurrence is a set of topological recurrence.


2 generated axial algebras of Monster type. In this paper we provide the basic setup for a project, initiated by Felix Rehren, aiming at classifying all 2 generated primitive axial agebras of Monster type ( alpha, beta) . We first revise Rehren's construction of an initial object in the cathegory of primitive n generated axial algebras giving a formal one, filling some gaps and, though correcting some inaccuracies, confirm Rehren's results. Then we focus on 2 generated algebras which naturally part into three cases the two critical cases alpha 2 beta and alpha 4 beta , and the generic case (i.e. all the rest). About these cases, which will be dealt in detail in subsequent papers, we give bounds on the dimensions (the generic case already treated by Rehen) and classify all 2 generated primitive axial algebras of Monster type ( alpha, beta) over mathbb Q( alpha, beta) for alpha and beta algebraically independent indeterminates over mathbb Q . Finally we restrict to the 2 generated Majorana algebras (i.e. when alpha frac 1 4 and beta frac 1 32 ), showing that these fall precisely into the nine isomorphism types of the Norton Sakuma algebras.


Introducing Type Properties. In type theory, we can express many practical ideas by attributing some additional data to expressions we operate on during compilation. For instance, some substructural type theories augment variables' typing judgments with the information of their usage. That is, they allow one to explicitly state how many times 0, 1, or many a variable can be used. This solves the problem of resource usage control and allows us to treat variables as resources. What's more, it often happens that this attributed information is interpreted (used) during the same compilation and erased before we run a program. A case in the point is that in the same substructural type theories, their type checkers use these 0, 1, or many, to ensure that all variables are used as many times as these attributions say them to be. Yet, there wasn't any programming language concept whose concern would be to allow a programmer to express these attributions in the language itself. That is, to let the programmer express which data the one wants to attribute to what expressions and, most importantly, the meaning of the attributed data in their program. As it turned out, the presence of such a concept allows us to express many practical ideas in the language itself. For instance, with appropriate means for assigning the meaning of these attributions, this concept would allow one to express linear types as functionality in a separate program module, without the need to refine the whole type system to add them. In this paper, we present such a concept we propose type properties. It allows a programmer to express these attributions while fulfilling the requirement of being fully on the static level. That is, it allows one to express how to interpret these attributions during compilation and erases them before a program is passed to the runtime.


Faster LTN a neuro symbolic, end to end object detection architecture. The detection of semantic relationships between objects represented in an image is one of the fundamental challenges in image interpretation. Neural Symbolic techniques, such as Logic Tensor Networks (LTNs), allow the combination of semantic knowledge representation and reasoning with the ability to efficiently learn from examples typical of neural networks. We here propose Faster LTN, an object detector composed of a convolutional backbone and an LTN. To the best of our knowledge, this is the first attempt to combine both frameworks in an end to end training setting. This architecture is trained by optimizing a grounded theory which combines labelled examples with prior knowledge, in the form of logical axioms. Experimental comparisons show competitive performance with respect to the traditional Faster R CNN architecture.


A multiscale model of vascular function in chronic thromboembolic pulmonary hypertension. Chronic thromboembolic pulmonary hypertension (CTEPH) is caused by recurrent or unresolved pulmonary thromboemboli, leading to perfusion defects and increased arterial wave reflections. CTEPH treatment aims to reduce pulmonary arterial pressure and reestablish adequate lung perfusion, yet patients with distal lesions are inoperable by standard surgical intervention. Instead, these patients undergo balloon pulmonary angioplasty (BPA), a multi session, minimally invasive surgery that disrupts the thromboembolic material within the vessel lumen using a catheter balloon. However, there still lacks an integrative, holistic tool for identifying optimal target lesions for treatment. To address this insufficiency, we simulate CTEPH hemodynamics and BPA therapy using a multiscale fluid dynamics model. The large pulmonary arterial geometry is derived from a computed tomography (CT) image, whereas a fractal tree represents the small vessels. We model ring and web like lesions, common in CTEPH, and simulate normotensive conditions and four CTEPH disease scenarios the latter includes both large artery lesions and vascular remodeling. BPA therapy is simulated by simultaneously reducing lesion severity in three locations. Our predictions mimic severe CTEPH, manifested by an increase in mean proximal pulmonary arterial pressure above 20 mmHg and prominent wave reflections. Both flow and pressure decrease in vessels distal to the lesions and increase in unobstructed vascular regions. We use the main pulmonary artery (MPA) pressure, a wave reflection index, and a measure of flow heterogeneity to select optimal target lesions for BPA. In summary, this study provides a multiscale, image to hemodynamics pipeline for BPA therapy planning for inoperable CTEPH patients.


Self Supervised Document Similarity Ranking via Contextualized Language Models and Hierarchical Inference. We present a novel model for the problem of ranking a collection of documents according to their semantic similarity to a source (query) document. While the problem of document to document similarity ranking has been studied, most modern methods are limited to relatively short documents or rely on the existence of "ground truth" similarity labels. Yet, in most common real world cases, similarity ranking is an unsupervised problem as similarity labels are unavailable. Moreover, an ideal model should not be restricted by documents' length. Hence, we introduce SDR, a self supervised method for document similarity that can be applied to documents of arbitrary length. Importantly, SDR can be effectively applied to extremely long documents, exceeding the 4,096 maximal token limits of Longformer. Extensive evaluations on large document datasets show that SDR significantly outperforms its alternatives across all metrics. To accelerate future research on unlabeled long document similarity ranking, and as an additional contribution to the community, we herein publish two human annotated test sets of long documents similarity evaluation. The SDR code and datasets are publicly available.


NDN4IVC A Framework for Simulating and Testing of Applications in Vehicular Named Data Networking. This paper presents a customized framework (NDN4IVC) for simulating and testing intelligent transportation systems and applications in vehicular named data networking (V NDN). The project uses two popular simulators in the literature for VANET simulation, a network simulator based on discrete events (Ns 3), with ndnSIM module installed, and Sumo, a simulator for urban mobility. NDN4IVC allows bidirectional communication between Sumo and Ns 3 and integrates the NDN stack and the NFD (NDN Forwarding Daemon) code. The project also brings together a comprehensive set of codes, models, functionalities, and technologies to improve proposals and protocols in V NDN.


Explainable Machine Larning for liver transplantation. In this work, we present a flexible method for explaining, in human readable terms, the predictions made by decision trees used as decision support in liver transplantation. The decision trees have been obtained through machine learning applied on a dataset collected at the liver transplantation unit at the Coru na University Hospital Center and are used to predict long term (five years) survival after transplantation. The method we propose is based on the representation of the decision tree as a set of rules in a logic program (LP) that is further annotated with text messages. This logic program is then processed using the tool xclingo (based on Answer Set Programming) that allows building compound explanations depending on the annotation text and the rules effectively fired when a given input is provided. We explore two alternative LP encodings one in which rules respect the tree structure (more convenient to reflect the learning process) and one where each rule corresponds to a (previously simplified) tree path (more readable for decision making).


Reducible normal generators for mapping class groups are abundant. In this article, we study the normal generation of the mapping class group. We first show that a mapping class is normal generator if its restriction on the invariant subsurface normally generates the (pure) mapping class group of the subsurface. As an application, we provided a criterion for reducible mapping classes to normally generate the mapping class groups in terms of its asymptotic translation lengths on Teichm "uller spaces. This is an analogue to the work of Lanier Margalit dealing with pseudo Anosov normal generators.


Maximizing Influence of Leaders in Social Networks. The operation of adding edges has been frequently used to the study of opinion dynamics in social networks for various purposes. In this paper, we consider the edge addition problem for the DeGroot model of opinion dynamics in a social network with n nodes and m edges, in the presence of a small number s ll n of competing leaders with binary opposing opinions 0 or 1. Concretely, we pose and investigate the problem of maximizing the equilibrium overall opinion by creating k new edges in a candidate edge set, where each edge is incident to a 1 valued leader and a follower node. We show that the objective function is monotone and submodular. We then propose a simple greedy algorithm with an approximation factor (1 frac 1 e ) that approximately solves the problem in O(n 3) time. Moreover, we provide a fast algorithm with a (1 frac 1 e epsilon) approximation ratio and tilde O (mk epsilon 2 ) time complexity for any epsilon 0 , where tilde O ( cdot) notation suppresses the rm poly ( log n) factors. Extensive experiments demonstrate that our second approximate algorithm is efficient and effective, which scales to large networks with more than a million nodes.


Automated Support for Unit Test Generation A Tutorial Book Chapter. Unit testing is a stage of testing where the smallest segment of code that can be tested in isolation from the rest of the system often a class is tested. Unit tests are typically written as executable code, often in a format provided by a unit testing framework such as pytest for Python. Creating unit tests is a time and effort intensive process with many repetitive, manual elements. To illustrate how AI can support unit testing, this chapter introduces the concept of search based unit test generation. This technique frames the selection of test input as an optimization problem we seek a set of test cases that meet some measurable goal of a tester and unleashes powerful metaheuristic search algorithms to identify the best possible test cases within a restricted timeframe. This chapter introduces two algorithms that can generate pytest formatted unit tests, tuned towards coverage of source code statements. The chapter concludes by discussing more advanced concepts and gives pointers to further reading for how artificial intelligence can support developers and testers when unit testing software.


Joint Face Image Restoration and Frontalization for Recognition. In real world scenarios, many factors may harm face recognition performance, e.g., large pose, bad illumination,low resolution, blur and noise. To address these challenges, previous efforts usually first restore the low quality faces to high quality ones and then perform face recognition. However, most of these methods are stage wise, which is sub optimal and deviates from the reality. In this paper, we address all these challenges jointly for unconstrained face recognition. We propose an Multi Degradation Face Restoration (MDFR) model to restore frontalized high quality faces from the given low quality ones under arbitrary facial poses, with three distinct novelties. First, MDFR is a well designed encoder decoder architecture which extracts feature representation from an input face image with arbitrary low quality factors and restores it to a high quality counterpart. Second, MDFR introduces a pose residual learning strategy along with a 3D based Pose Normalization Module (PNM), which can perceive the pose gap between the input initial pose and its real frontal pose to guide the face frontalization. Finally, MDFR can generate frontalized high quality face images by a single unified network, showing a strong capability of preserving face identity. Qualitative and quantitative experiments on both controlled and in the wild benchmarks demonstrate the superiority of MDFR over state of the art methods on both face frontalization and face restoration.


A Link Diagram Visualizing Relations between Two Ordered Sets. This article provides a link diagram to visualize relations between two ordered sets representing precedences on decision making options or solutions to strategic form games. The diagram consists of floating loops whose any two loops cross just twice each other. As problems formulated by relations between two ordered sets, I give two examples visualizing rankings from pairwise comparisons on the diagram and finding Pareto optimal solutions to a game of prisoners' dilemma. At visualizing rankings, we can see whether a ranking satisfies Condorcet's principle or not by checking whether the top loop is splittable or not. And at finding solutions to the game, when a solution of the game of prisoners' dilemma is Pareto optimal, the loop corresponding to the solution has no splittable loop above it. Throughout the article, I point out that checking the splittability of loops is an essence. I also mention that the diagram can visualize natural transformations between two functors on free construction categories.


A Survey on Neural symbolic Systems. In recent years, neural systems have demonstrated superior perceptual intelligence through highly effective learning, but their reasoning capabilities remain poor. In contrast, symbolic systems have exceptional cognitive intelligence through efficient reasoning, but their learning capabilities are poor. In this case, an ideal intelligent system a neural symbolic system with high perceptual and cognitive intelligence through powerful learning and reasoning capabilities gains a growing interest in the research community. Combining the fast computation ability of neural systems and the powerful expression ability of symbolic systems, neural symbolic systems can perform effective learning and reasoning in multi domain tasks, demonstrating concurrent perception and cognition capabilities in intelligent systems. This paper surveys the latest research in neural symbolic systems along four dimensions the necessity of combination, technical challenges, methods, and applications. This paper aims to help advance this emerging area of research by providing researchers with a holistic and comprehensive view, highlighting the state of art and identifying the opportunities.


Adaptive Methods for Aggregated Domain Generalization. Domain generalization involves learning a classifier from a heterogeneous collection of training sources such that it generalizes to data drawn from similar unknown target domains, with applications in large scale learning and personalized inference. In many settings, privacy concerns prohibit obtaining domain labels for the training data samples, and instead only have an aggregated collection of training points. Existing approaches that utilize domain labels to create domain invariant feature representations are inapplicable in this setting, requiring alternative approaches to learn generalizable classifiers. In this paper, we propose a domain adaptive approach to this problem, which operates in two steps (a) we cluster training data within a carefully chosen feature space to create pseudo domains, and (b) using these pseudo domains we learn a domain adaptive classifier that makes predictions using information about both the input and the pseudo domain it belongs to. Our approach achieves state of the art performance on a variety of domain generalization benchmarks without using domain labels whatsoever. Furthermore, we provide novel theoretical guarantees on domain generalization using cluster information. Our approach is amenable to ensemble based methods and provides substantial gains even on large scale benchmark datasets. The code can be found at https github.com xavierohan AdaClust DomainBed


Towards Corruption Agnostic Robust Domain Adaptation. Big progress has been achieved in domain adaptation in decades. Existing works are always based on an ideal assumption that testing target domain are i.i.d. with training target domains. However, due to unpredictable corruptions (e.g., noise and blur) in real data like web images, domain adaptation methods are increasingly required to be corruption robust on target domains. In this paper, we investigate a new task, Corruption agnostic Robust Domain Adaptation (CRDA) to be accurate on original data and robust against unavailable for training corruptions on target domains. This task is non trivial due to large domain discrepancy and unsupervised target domains. We observe that simple combinations of popular methods of domain adaptation and corruption robustness have sub optimal CRDA results. We propose a new approach based on two technical insights into CRDA 1) an easy to plug module called Domain Discrepancy Generator (DDG) that generates samples that enlarge domain discrepancy to mimic unpredictable corruptions 2) a simple but effective teacher student scheme with contrastive loss to enhance the constraints on target domains. Experiments verify that DDG keeps or even improves performance on original data and achieves better corruption robustness that baselines.


A Survey on Temporal Sentence Grounding in Videos. Temporal sentence grounding in videos(TSGV), which aims to localize one target segment from an untrimmed video with respect to a given sentence query, has drawn increasing attentions in the research community over the past few years. Different from the task of temporal action localization, TSGV is more flexible since it can locate complicated activities via natural languages, without restrictions from predefined action categories. Meanwhile, TSGV is more challenging since it requires both textual and visual understanding for semantic alignment between two modalities(i.e., text and video). In this survey, we give a comprehensive overview for TSGV, which i) summarizes the taxonomy of existing methods, ii) provides a detailed description of the evaluation protocols(i.e., datasets and metrics) to be used in TSGV, and iii) in depth discusses potential problems of current benchmarking designs and research directions for further investigations. To the best of our knowledge, this is the first systematic survey on temporal sentence grounding. More specifically, we first discuss existing TSGV approaches by grouping them into four categories, i.e., two stage methods, end to end methods, reinforcement learning based methods, and weakly supervised methods. Then we present the benchmark datasets and evaluation metrics to assess current research progress. Finally, we discuss some limitations in TSGV through pointing out potential problems improperly resolved in the current evaluation protocols, which may push forwards more cutting edge research in TSGV. Besides, we also share our insights on several promising directions, including three typical tasks with new and practical settings based on TSGV.


The Inductive Bias of In Context Learning Rethinking Pretraining Example Design. Pretraining Neural Language Models (NLMs) over a large corpus involves chunking the text into training examples, which are contiguous text segments of sizes processable by the neural architecture. We highlight a bias introduced by this common practice we prove that the pretrained NLM can model much stronger dependencies between text segments that appeared in the same training example, than it can between text segments that appeared in different training examples. This intuitive result has a twofold role. First, it formalizes the motivation behind a broad line of recent successful NLM training heuristics, proposed for the pretraining and fine tuning stages, which do not necessarily appear related at first glance. Second, our result clearly indicates further improvements to be made in NLM pretraining for the benefit of Natural Language Understanding tasks. As an example, we propose "kNN Pretraining" we show that including semantically related non neighboring sentences in the same pretraining example yields improved sentence representations and open domain question answering abilities. This theoretically motivated degree of freedom for pretraining example design indicates new training schemes for self improving representations.


Homogenization of a nonlinear monotone problem in a locally periodic domain via unfolding method. In this paper, the asymptotic behavior of the solutions of a monotone problem posed in a locally periodic oscillating domain is studied. Nonlinear monotone boundary conditions are imposed on the oscillating part of the boundary whereas the Dirichlet condition is considered on the smooth separate part. Using the unfolding method, under natural hypothesis on the regularity of the domain, we prove the weak L 2 convergence of the zero extended solutions of the nonlinear problem and their flows to the solutions of a limit distributional problem.


Fuzzy Win Win A Novel Approach to Quantify Win Win Using Fuzzy Logic. The classic win win has a key flaw in that it cannot offer the parties the right amounts of winning because each party believes they are winners. In reality, one party may win more than the other. This strategy is not limited to a single product or negotiation it may be applied to a variety of situations in life. We present a novel way to measure the win win situation in this paper. The proposed method employs Fuzzy logic to create a mathematical model that aids negotiators in quantifying their winning percentages. The model is put to the test on real life negotiations scenarios such as the Iraqi Jordanian oil deal, and the iron ore negotiation (2005 2009). The presented model has shown to be a useful tool in practice and can be easily generalized to be utilized in other domains as well.


COVID Induced Digital Inequality for Senior Citizens. The global pandemic of COVID 19 has fundamentally changed how people interact, especially with the introduction of technology based measures that aim at curbing the spread of the virus. As the country that currently implements one of the tightest technology based COVID prevention policy, China has protected its citizen with a prolonged peaceful time of zero case as well as a fast reaction to potential upsurging of the disease. However, such mobile based technology does come with sacrifices, especially for senior citizens who find themselves difficult to adapt to modern technologies. In this study, we demonstrated the fact that most senior citizens find it difficult to use the health code apps called ''JKM'', to which they responded by cutting down on travel and reducing local commuting to locations where the verification of JKM is needed. Such compromise has physical and mental consequences and leads to inequalities in infrastructure, social isolation and self sufficiency. As we illustrated in the paper, such decrease in life quality of senior citizens can be greatly reduced if improvements on the user interactions of the JKM can be implemented. To the best of our knowledge, we are the first systemic study of digital inequality due to mobile based COVID prevention technologies for senior citizens in China. As similar technologies become widely adopted around the world, we wish to shed light on how widened digital inequality increasingly affects the life quality of senior citizens in the pandemic era.


Assouad like dimensions of random Moran measures. In this paper, we determine the almost sure values of the Phi dimensions of random measures supported on random Moran sets that satisfy a uniform separation condition. The Phi dimensions are intermediate Assouad like dimensions, the (quasi )Assouad dimensions and theta Assouad spectrum being special cases. Their values depend on the size of Phi , with one size coinciding with the Assouad dimension and the other coinciding with the quasi Assouad dimension. We give many applications, including to equicontractive self similar measures and 1 variable random Moran measures such as Cantor like measures with probabilities that are uniformly distributed. We can also deduce the Phi dimensions of the underlying random sets.


Critical Droplets and sharp asymptotics for Kawasaki dynamics with weakly anisotropic interactions. Extended version. In this paper we analyze metastability and nucleation in the context of the Kawasaki dynamics for the two dimensional Ising lattice gas at very low temperature with periodic boundary conditions. Let beta 0 be the inverse temperature and let Lambda subset Lambda beta subset mathbb Z 2 be two boxes. We consider the asymptotic regime corresponding to the limit as beta rightarrow infty for finite volume Lambda and lim beta rightarrow infty frac 1 beta log Lambda beta infty . We study the simplified model, in which particles perform independent random walks on Lambda beta setminus Lambda and inside Lambda particles perform simple exclusion, but when they occupy neighboring sites they feel a binding energy U 1 0 in the horizontal direction and U 2 0 in the vertical one. Thus the Kawasaki dynamics is conservative inside the volume Lambda beta . The initial configuration is chosen such that Lambda is empty and rho Lambda beta particles are distributed randomly over Lambda beta setminus Lambda . Our results will use a deep analysis of a local model, i.e., particles perform Kawasaki dynamics inside Lambda and along each bond touching the boundary of Lambda from the outside to the inside, particles are created with rate rho e Delta beta , while along each bond from the inside to the outside, particles are annihilated with rate 1 , where Delta 0 is an activity parameter. Thus, in the local model the boundary of Lambda plays the role of an infinite gas reservoir with density rho . We take Delta in (U 1,U 1 U 2) , so that the empty (respectively full) configuration is a metastable (respectively stable) configuration. We investigate how the transition from empty to full takes place in the local model with particular attention to the critical configurations that asymptotically have to be crossed with probability 1.